
Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Community
Ask the community for help and clear up your study doubts
Discover the best universities in your country according to Docsity users
Free resources
Download our free guides on studying techniques, anxiety management strategies, and thesis advice from Docsity tutors
Jesus Christ, how much Information do you need for this random document?
Typology: Summaries
1 / 1
This page cannot be seen from the preview
Don't miss anything!
Privacy policy About Wikipedia Disclaimers Contact Wikipedia Code of Conduct Developers Statistics Cookie statement Mobile view
This page was last edited on 11 April 2024, at 03:54 (UTC).
Text is available under the Creative Commons Attribution-ShareAlike License 4.0; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia® is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization.
Contents
hide
(Top)
Practical applications and uses
True vs. pseudo-random numbers
Generation methods
Physical methods
Computational methods
By humans
Post-processing and statistical
checks
Other considerations
Reshaping the distribution
Uniform distributions
Other distributions
Whitening
Low-discrepancy sequences as an
alternative
Activities and demonstrations
Backdoors
See also
References
Further reading
External links
22 languages
Article Talk Read Edit View history Tools
Dice are an example of a
mechanical hardware random number
generator. When a cubical die is rolled,
a random number from 1 to 6 is
obtained.
Demonstration of a simple
random number generator
based on where and when a
button is clicked
From Wikipedia, the free encyclopedia
Random number generation is a process by which, often by means of a random number generator ( RNG ), a
sequence of numbers or symbols that cannot be reasonably predicted better than by random chance is
generated. This means that the particular outcome sequence will contain some patterns detectable in hindsight
but impossible to foresee. True random number generators can be hardware random-number generators
(HRNGs), wherein each generation is a function of the current value of a physical environment's attribute that is
constantly changing in a manner that is practically impossible to model. This would be in contrast to so-called
"random number generations" done by pseudorandom number generators (PRNGs), which generate numbers
that only look random but are in fact pre-determined—these generations can be reproduced simply by knowing
the state of the PRNG.
[1]
Various applications of randomness have led to the development of different methods for generating random
data. Some of these have existed since ancient times, including well-known examples like the rolling of dice,
coin flipping, the shuffling of playing cards, the use of yarrow stalks (for divination) in the I Ching, as well as
countless other techniques. Because of the mechanical nature of these techniques, generating large quantities of sufficiently random numbers (important
in statistics) required much work and time. Thus, results would sometimes be collected and distributed as random number tables.
Several computational methods for pseudorandom number generation exist. All fall short of the goal of true randomness, although they may meet, with
varying success, some of the statistical tests for randomness intended to measure how unpredictable their results are (that is, to what degree their
patterns are discernible). This generally makes them unusable for applications such as cryptography. However, carefully designed cryptographically
secure pseudorandom number generators (CSPRNGS) also exist, with special features specifically designed for use in cryptography.
Main article: Applications of randomness
Random number generators have applications in gambling, statistical sampling, computer simulation, cryptography, completely randomized design, and
other areas where producing an unpredictable result is desirable. Generally, in applications having unpredictability as the paramount feature, such as in
security applications, hardware generators are generally preferred over pseudorandom algorithms, where feasible.
Pseudorandom number generators are very useful in developing Monte Carlo-method simulations, as debugging is facilitated by the ability to run the
same sequence of random numbers again by starting from the same random seed. They are also used in cryptography – so long as the seed is secret.
The sender and receiver can generate the same set of numbers automatically to use as keys.
The generation of pseudorandom numbers is an important and common task in computer programming. While cryptography and certain numerical
algorithms require a very high degree of apparent randomness, many other operations only need a modest amount of unpredictability. Some simple
examples might be presenting a user with a "random quote of the day", or determining which way a computer-controlled adversary might move in a
computer game. Weaker forms of randomness are used in hash algorithms and in creating amortized searching and sorting algorithms.
Some applications that appear at first sight to be suitable for randomization are in fact not quite so simple. For instance, a system that "randomly" selects
music tracks for a background music system must only appear random, and may even have ways to control the selection of music: a truly random
system would have no restriction on the same item appearing two or three times in succession.
Main articles: Pseudorandom number generator and Hardware random number generator
See also: Cryptographically secure pseudorandom number generator
There are two principal methods used to generate random numbers. The first method measures some physical phenomenon that is expected to be
random and then compensates for possible biases in the measurement process. Example sources include measuring atmospheric noise, thermal noise,
and other external electromagnetic and quantum phenomena. For example, cosmic background radiation or radioactive decay as measured over short
timescales represent sources of natural entropy (as a measure of unpredictability or surprise of the number generation process).
The speed at which entropy can be obtained from natural sources is dependent on the underlying physical phenomena being measured. Thus, sources
of naturally occurring "true" entropy are said to be blocking – they are rate-limited until enough entropy is harvested to meet the demand. On some Unix-
like systems, including most Linux distributions, the pseudo device file /dev/random will block until sufficient entropy is harvested from the environment.
[2]
Due to this blocking behavior, large bulk reads from /dev/random, such as filling a hard disk drive with random bits, can often be slow on systems
that use this type of entropy source.
The second method uses computational algorithms that can produce long sequences of apparently random results, which are in fact completely
determined by a shorter initial value, known as a seed value or key. As a result, the entire seemingly random sequence can be reproduced if the seed
value is known. This type of random number generator is often called a pseudorandom number generator. This type of generator typically does not rely
on sources of naturally occurring entropy, though it may be periodically seeded by natural sources. This generator type is non-blocking, so they are not
rate-limited by an external event, making large bulk reads a possibility.
Some systems take a hybrid approach, providing randomness harvested from natural sources when available, and falling back to periodically re-seeded
software-based cryptographically secure pseudorandom number generators (CSPRNGs). The fallback occurs when the desired read rate of randomness
exceeds the ability of the natural harvesting approach to keep up with the demand. This approach avoids the rate-limited blocking behavior of random
number generators based on slower and purely environmental methods.
While a pseudorandom number generator based solely on deterministic logic can never be regarded as a "true" random number source in the purest
sense of the word, in practice they are generally sufficient even for demanding security-critical applications. Carefully designed and implemented
pseudorandom number generators can be certified for security-critical cryptographic purposes, as is the case with the yarrow algorithm and fortuna. The
former is the basis of the /dev/random source of entropy on FreeBSD, AIX, OS X, NetBSD, and others. OpenBSD uses a pseudorandom number
algorithm known as arc4random.
[ dubious – discuss ][3]
Main article: Hardware random number generator
The earliest methods for generating random numbers, such as dice, coin flipping and roulette wheels, are still used today, mainly in games and gambling
as they tend to be too slow for most applications in statistics and cryptography.
A physical random number generator can be based on an essentially random atomic or subatomic physical phenomenon whose unpredictability can be
traced to the laws of quantum mechanics.
[4][5]
Sources of entropy include radioactive decay, thermal noise, shot noise, avalanche noise in Zener diodes,
clock drift, the timing of actual movements of a hard disk read-write head, and radio noise. However, physical phenomena and tools used to measure
them generally feature asymmetries and systematic biases that make their outcomes not uniformly random. A randomness extractor, such as a
cryptographic hash function, can be used to approach a uniform distribution of bits from a non-uniformly random source, though at a lower bit rate.
The appearance of wideband photonic entropy sources, such as optical chaos and amplified spontaneous emission noise, greatly aid the development of
the physical random number generator. Among them, optical chaos
[6][7]
has a high potential to physically produce high-speed random numbers due to its
high bandwidth and large amplitude. A prototype of a high-speed, real-time physical random bit generator based on a chaotic laser was built in 2013.
[8]
Various imaginative ways of collecting this entropic information have been devised. One technique is to run a hash function against a frame of a video
stream from an unpredictable source. Lavarand used this technique with images of a number of lava lamps. HotBits measured radioactive decay with
Geiger–Muller tubes,
[9]
while Random.org uses variations in the amplitude of atmospheric noise recorded with a normal radio.
Another common entropy source is the behavior of human users of the system. While people are not considered good
randomness generators upon request, they generate random behavior quite well in the context of playing mixed strategy
games.
[10]
Some security-related computer software requires the user to make a lengthy series of mouse movements or
keyboard inputs to create sufficient entropy needed to generate random keys or to initialize pseudorandom number
generators.
[11]
Main article: Pseudorandom number generation
Most computer-generated random numbers use PRNGs which are algorithms that can automatically create long runs of
numbers with good random properties but eventually the sequence repeats (or the memory usage grows without bound).
These random numbers are fine in many situations but are not as random as numbers generated from electromagnetic
atmospheric noise used as a source of entropy.
[12]
The series of values generated by such algorithms is generally
determined by a fixed number called a seed. One of the most common PRNG is the linear congruential generator, which uses the recurrence
statistical properties.
[13]
To avoid certain non-random properties of a single linear congruential generator, several such random number generators with
several different generators.
A simple pen-and-paper method for generating random numbers is the so-called middle-square method suggested by John von Neumann. While simple
to implement, its output is of poor quality. It has a very short period and severe weaknesses, such as the output sequence almost always converging to
zero. A recent innovation is to combine the middle square with a Weyl sequence. This method produces high-quality output through a long period.
[14]
Most computer programming languages include functions or library routines that provide random number generators. They are often designed to provide
a random byte or word, or a floating point number uniformly distributed between 0 and 1.
The quality i.e. randomness of such library functions varies widely from completely predictable output, to cryptographically secure. The default random
number generator in many languages, including Python, Ruby, R, IDL and PHP is based on the Mersenne Twister algorithm and is not sufficient for
cryptography purposes, as is explicitly stated in the language documentation. Such library functions often have poor statistical properties and some will
repeat patterns after only tens of thousands of trials. They are often initialized using a computer's real-time clock as the seed, since such a clock is 64 bit
and measures in nanoseconds, far beyond the person's precision. These functions may provide enough randomness for certain tasks (for example video
games) but are unsuitable where high-quality randomness is required, such as in cryptography applications, statistics or numerical analysis.
[ citation needed ]
Much higher quality random number sources are available on most operating systems; for example /dev/random on various BSD flavors, Linux, Mac OS
X, IRIX, and Solaris, or CryptGenRandom for Microsoft Windows. Most programming languages, including those mentioned above, provide a means to
access these higher-quality sources.
Random number generation may also be performed by humans, in the form of collecting various inputs from end users and using them as a
randomization source. However, most studies find that human subjects have some degree of non-randomness when attempting to produce a random
sequence of e.g. digits or letters. They may alternate too much between choices when compared to a good random generator;
[15]
thus, this approach is
not widely used.
See also: Randomness tests, Statistical randomness, and List of random number generators
Even given a source of plausible random numbers (perhaps from a quantum mechanically based hardware generator), obtaining numbers which are
completely unbiased takes care. In addition, behavior of these generators often changes with temperature, power supply voltage, the age of the device,
or other outside interference.
Generated random numbers are sometimes subjected to statistical tests before use to ensure that the underlying source is still working, and then post-
processed to improve their statistical properties. An example would be the TRNG
[16]
hardware random number generator, which uses an entropy
measurement as a hardware test, and then post-processes the random sequence with a shift register stream cipher. It is generally hard to use statistical
tests to validate the generated random numbers. Wang and Nicol
[17]
proposed a distance-based statistical testing technique that is used to identify the
weaknesses of several random generators. Li and Wang
[18]
proposed a method of testing random numbers based on laser chaotic entropy sources
using Brownian motion properties.
Statistical tests are also used to give confidence that the post-processed final output from a random number generator is truly unbiased, with numerous
randomness test suites being developed.
Uniform distributions [ edit ]
Most random number generators natively work with integers or individual bits, so an extra step is required to arrive at the "canonical" uniform distribution
between 0 and 1. The implementation is not as trivial as dividing the integer by its maximum possible value. Specifically:
[19][20]
due to the sheer number of bits required.
number math.
The mainstream algorithm, used by OpenJDK, Rust, and NumPy, is described in a proposal for C++'s STL. It does not use the extra precision and
suffers from bias only in the last bit due to round-to-even.
[21]
Other numeric concerns are warranted when shifting this "canonical" uniform distribution to
a different range.
[22]
A proposed method for the Swift programming language claims to use the full precision everywhere.
[23]
Uniformly distributed integers are commonly used in algorithms such as the Fisher–Yates shuffle. Again, a naive implementation may induce a modulo
bias into the result, so more involved algorithms must be used. A method that nearly never performs division was described in 2018 by Daniel Lemire,
[24]
with the current state-of-the-art being the arithmetic encoding-inspired 2021 "optimal algorithm" by Stephen Canon of Apple Inc.
[25]
Most 0 to 1 RNGs include 0 but exclude 1, while others include or exclude both.
Other distributions [ edit ]
Main article: Pseudo-random number sampling
See also: cumulative distribution function and quantile function
Given a source of uniform random numbers, there are a couple of methods to create a new random source that corresponds to a probability density
function. One method called the inversion method, involves integrating up to an area greater than or equal to the random number (which should be
generated between 0 and 1 for proper distributions). A second method called the acceptance-rejection method, involves choosing an x and y value and
testing whether the function of x is greater than the y value. If it is, the x value is accepted. Otherwise, the x value is rejected and the algorithm tries
again.
[26][27]
As an example for rejection sampling, to generate a pair of statistically independent standard normally distributed random numbers ( x , y ), one may first
generate the polar coordinates ( r , θ ), where r
2
~χ
2
2
and θ ~UNIFORM(0,2π) (see Box–Muller transform).
The outputs of multiple independent RNGs can be combined (for example, using a bit-wise XOR operation) to provide a combined RNG at least as good
as the best RNG used. This is referred to as software whitening.
Computational and hardware random number generators are sometimes combined to reflect the benefits of both kinds. Computational random number
generators can typically generate pseudorandom numbers much faster than physical generators, while physical generators can generate "true
randomness."
Some computations making use of a random number generator can be summarized as the computation of a total or average value, such as the
computation of integrals by the Monte Carlo method. For such problems, it may be possible to find a more accurate solution by the use of so-called low-
discrepancy sequences, also called quasirandom numbers. Such sequences have a definite pattern that fills in gaps evenly, qualitatively speaking; a truly
random sequence may, and usually does, leave larger gaps.
The following sites make available random number samples:
The SOCR resource pages contain a number of hands-on interactive activities and demonstrations of random number generation using Java applets.
The Quantum Optics Group at the ANU generates random numbers sourced from quantum vacuum. Samples of random numbers are available at
their quantum random number generator research page.
Random.org makes available random numbers that are sourced from the randomness of atmospheric noise.
The Quantum Random Bit Generator Service at the Ruđer Bošković Institute harvests randomness from the quantum process of photonic emission in
semiconductors. They supply a variety of ways of fetching the data, including libraries for several programming languages.
The Group at the Taiyuan University of Technology generates random numbers sourced from a chaotic laser. Samples of random numbers are
available at their physical random number generator service.
Main article: Random number generator attack
Further information: Backdoor (computing)
Since much cryptography depends on a cryptographically secure random number generator for key and cryptographic nonce generation, if a random
number generator can be made predictable, it can be used as backdoor by an attacker to break the encryption.
The NSA is reported to have inserted a backdoor into the NIST certified cryptographically secure pseudorandom number generator Dual EC DRBG. If for
example an SSL connection is created using this random number generator, then according to Matthew Green it would allow NSA to determine the state
of the random number generator, and thereby eventually be able to read all data sent over the SSL connection.
[28]
Even though it was apparent that
Dual_EC_DRBG was a very poor and possibly backdoored pseudorandom number generator long before the NSA backdoor was confirmed in 2013, it
had seen significant usage in practice until 2013, for example by the prominent security company RSA Security.
[29]
There have subsequently been
accusations that RSA Security knowingly inserted a NSA backdoor into its products, possibly as part of the Bullrun program. RSA has denied knowingly
inserting a backdoor into its products.
[30]
It has also been theorized that hardware RNGs could be secretly modified to have less entropy than stated, which would make encryption using the
hardware RNG susceptible to attack. One such method that has been published works by modifying the dopant mask of the chip, which would be
undetectable to optical reverse-engineering.
[31]
For example, for random number generation in Linux, it is seen as unacceptable to use Intel's RDRAND
hardware RNG without mixing in the RDRAND output with other sources of entropy to counteract any backdoors in the hardware RNG, especially after
the revelation of the NSA Bullrun program.
[32][33]
In 2010, a U.S. lottery draw was rigged by the information security director of the Multi-State Lottery Association (MUSL), who surreptitiously installed
backdoor malware on the MUSL's secure RNG computer during routine maintenance.
[34]
During the hacks the man won a total amount of $16,500,
by predicting the numbers correctly a few times in year.
Donald Knuth (1997). "Chapter 3 – Random Numbers". The Art of Computer Programming. Vol. 2: Seminumerical algorithms (3 ed.).
L'Ecuyer, Pierre (2017). "History of Uniform Random Number Generation" (PDF). Proceedings of the 2017 Winter Simulation Conference. IEEE
Press. pp. 202–230.
L'Ecuyer, Pierre (2012). "Random Number Generation" (PDF). In J. E. Gentle; W. Haerdle; Y. Mori (eds.). Handbook of Computational Statistics:
Concepts and Methods. Handbook of Computational Statistics (second ed.). Springer-Verlag. pp. 35–71. doi:10.1007/978-3-642-21551-3_.
hdl:10419/22195. ISBN 978-3-642-21550-6.
Kroese, D. P.; Taimre, T.; Botev, Z.I. (2011). "Chapter 1 – Uniform Random Number Generation". Handbook of Monte Carlo Methods. New York:
John Wiley & Sons. p. 772. ISBN 978-0-470-17793-8.
Press, WH; Teukolsky, SA; Vetterling, WT; Flannery, BP (2007). "Chapter 7. Random Numbers". Numerical Recipes: The Art of Scientific
Computing (3rd ed.). New York: Cambridge University Press. ISBN 978-0-521-88068-8.
NIST SP800-90A, B, C series on random number generation
M. Tomassini; M. Sipper; M. Perrenoud (October 2000). "On the generation of high-quality random numbers by two-dimensional cellular automata".
IEEE Transactions on Computers. 49 (10): 1146–1151. doi:10.1109/12.888056. S2CID 10139169.
RANDOM.ORG True Random Number Service
Quantum random number generator at ANU
Random and Pseudorandom on In Our Time at the BBC
jRand a Java-based framework for the generation of simulation sequences, including pseudorandom sequences of numbers
Random number generators in NAG Fortran Library
Randomness Beacon at NIST, broadcasting full entropy bit-strings in blocks of 512 bits every 60 seconds. Designed to provide unpredictability,
autonomy, and consistency.
A system call for random numbers: getrandom() , a LWN.net article describing a dedicated Linux system call
Statistical Properties of Pseudo Random Sequences and Experiments with PHP and Debian OpenSSL
Random Sequence Generator based on Avalanche Noise
Authority control databases: National Germany · Israel · United States
Categories: Random number generation Information theory
Flipism
League of entropy
List of random number generators
PP (complexity)
Procedural generation
Randomized algorithm
Random password generator
Random variable, contains a chance-dependent value
Vincent; Tellenbach, Bernhard (eds.), "Random Number Generator" ,
Trends in Data Protection and Encryption Technologies , Cham: Springer
Nature Switzerland, pp. 31–34, doi:10.1007/978-3-031-33386-6_7 ,
ISBN 978-3-031-33386-6, retrieved 2023-10-
random number generators". Reviews of Modern Physics. 89.
arXiv:1604.03304. doi:10.1103/RevModPhys.89..
S2CID 118592321.
(2021). "Quantum generators of random numbers". Scientific Reports. 11
(1): 16108. doi:10.1038/s41598-021-95388-7. PMC 8352985.
PMID 34373502.
random number generator". Optics Express. 18 (19): 20360–20369.
Bibcode:2010OExpr..1820360L. doi:10.1364/OE.18..
ISSN 1094-4087. PMID 20940928.
Xiaomin; Guo, Yanqiang; Wang, Yuncai (2016-07-15). "Fully photonics-
based physical random bit generator". Optics Letters. 41 (14): 3347–3350.
Bibcode:2016OptL...41.3347L. doi:10.1364/OL.41.003347. ISSN 1539-
PMID 27420532. S2CID 2909061.
^ Wang, Anbang; Li, Pu; Zhang, Jianguo; Zhang, Jianzhong; Li, Lei; Wang,
Yuncai (2013-08-26). "4.5 Gbps high-speed real-time physical random bit
generator". Optics Express. 21 (17): 20452–20462.
Bibcode:2013OExpr..2120452W. doi:10.1364/OE.21..
ISSN 1094-4087. PMID 24105589. S2CID 10397141.
2009-06-27.
Weizmann Institute of Science. Archived from the original (PDF) on 2011-
08-07. Retrieved 2009-06-27.
2009-06-27.
Retrieved 2016-01-14.
2018-11-21.
arXiv:1704.00358 [cs.CR ].
subjects: a critical survey of the literature". Psychological Bulletin. 77 (1):
65–72. CiteSeerX 10.1.1.211.9085. doi:10.1037/h.
Manufacturer: www.TRNG98.se.
Sequences and Experiments with PHP and Debian OpenSSL". Computer
Security - ESORICS 2014. Lecture Notes in Computer Science. Vol. 8712.
Heidelberg: Springer LNCS. pp. 454–471. doi:10.1007/978-3-319-11203-
9_26. ISBN 978-3-319-11202-2.
07-11). "Brownian motion properties of optoelectronic random bit generators
based on laser chaos". Optics Express. 24 (14): 15822–15833.
Bibcode:2016OExpr..2415822L. doi:10.1364/OE.24..
ISSN 1094-4087. PMID 27410852.
Dividing Integers: A Case Study". Computational Science – ICCS 2020.
ICCS. Lecture Notes in Computer Science. Vol. 12138. pp. 15–28.
doi:10.1007/978-3-030-50417-5_2. ISBN 978-3-030-50416-8.
S2CID 219889587.
double-precision floating-point number in [0, 1] uniformly at random given a
uniform random source of bits". Retrieved 4 September 2021.
from an interval". HAL. Retrieved 4 September 2021.
NevinBR · Pull Request #33560 · apple/swift". GitHub.
an Interval". ACM Transactions on Modeling and Computer Simulation. 29
(1): 1–12. arXiv:1805.10941. doi:10.1145/3230636. S2CID 44061046.
Request #39143 · apple/swift". GitHub.
[ permanent dead link ]
Generators" (PDF). NAG Library Manual, Mark 23. Retrieved 2012-02-09.
products".
customers". Ars Technica. 2013-09-20.
CPUs". Ars Technica. 2013-09-18.
/dev/random rely only on the RDRAND instruction". Google Plus.
architectures". LWN.
Daily Beast. Retrieved July 10, 2015.
Search Search Wikipedia Create account Log in