我需要生成许多固定长度的随机十六进制字符串。
我正在做这样的事情:
const letterBytes = "abcdef0123456789" const ( letterIdxBits = 6 // 6 bits to represent a letter index letterIdxMask = 1<<letterIdxBits - 1 // All 1-bits, as many as letterIdxBits letterIdxMax = 63 / letterIdxBits // # of letter indices fitting in 63 bits ) var src = rand.NewSource(time.Now().UnixNano()) // RandStringBytesMaskImprSrc ... // Src: https://stackoverflow.com/a/31832326/710955 func RandStringBytesMaskImprSrc(n int) string { b := make([]byte, n) // A src.Int63() generates 63 random bits, enough for letterIdxMax characters! for i, cache, remain := n-1, src.Int63(), letterIdxMax; i >= 0; { if remain == 0 { cache, remain = src.Int63(), letterIdxMax } if idx := int(cache & letterIdxMask); idx < len(letterBytes) { b[i] = letterBytes[idx] i-- } cache >>= letterIdxBits remain-- } return string(b) } var tryArr = make([]string, 10000) for i := 0; i < 10000; i++ { tryArr[i] = RandStringBytesMaskImprSrc(8) }
但是我遇到了这个紧急错误
panic: runtime error: index out of range goroutine 36 [running]: math/rand.(*rngSource).Int63(0x11bb1300, 0x8, 0x8) D:/Applications/Go/src/math/rand/rng.go:231 +0xa0 main.RandStringBytesMaskImprSrc(0x8, 0x11f81be8, 0x8) main.go:60 +0x5f
错误似乎在 for i, cache, remain := n-1, src.Int63(), letterIdxMax; i >= 0;,但我不知道为什么会出现此错误。
for i, cache, remain := n-1, src.Int63(), letterIdxMax; i >= 0;
在Go中生成大量固定长度的随机十六进制字符串的最快,最简单的方法是什么?
基准测试
package bench import ( "encoding/hex" "math/rand" "testing" "time" ) const letterBytes = "abcdef0123456789" const ( letterIdxBits = 4 // 4 bits to represent a letter index letterIdxMask = 1<<letterIdxBits - 1 // All 1-bits, as many as letterIdxBits letterIdxMax = 63 / letterIdxBits // # of letter indices fitting in 63 bits ) var src1 = rand.NewSource(time.Now().UnixNano()) var src2 = rand.New(rand.NewSource(time.Now().UnixNano())) // RandStringBytesMaskImprSrc returns a random hexadecimal string of length n. func RandStringBytesMaskImprSrc1(n int) string { b := make([]byte, n) for i, cache, remain := n-1, src1.Int63(), letterIdxMax; i >= 0; { if remain == 0 { cache, remain = src1.Int63(), letterIdxMax } if idx := int(cache & letterIdxMask); idx < len(letterBytes) { b[i] = letterBytes[idx] i-- } cache >>= letterIdxBits remain-- } return string(b) } func RandStringBytesMaskImprSrc2(n int) string { b := make([]byte, (n+1)/2) // can be simplified to n/2 if n is always even if _, err := src2.Read(b); err != nil { panic(err) } return hex.EncodeToString(b)[:n] } func BenchmarkRandStringBytesMaskImprSrc1(b *testing.B) { for n := 0; n < b.N; n++ { _ = RandStringBytesMaskImprSrc1(8) } } func BenchmarkRandStringBytesMaskImprSrc2(b *testing.B) { for n := 0; n < b.N; n++ { _ = RandStringBytesMaskImprSrc2(8) } } goos: windows goarch: 386 BenchmarkRandStringBytesMaskImprSrc1-4 20000000 116 ns/op 16 B/op 2 allocs/op BenchmarkRandStringBytesMaskImprSrc2-4 10000000 231 ns/op 24 B/op 3 allocs/op PASS ok command-line-arguments 5.139s
=> icza RandStringBytesMaskImprSrc解决方案更有效
RandStringBytesMaskImprSrc
实际上,您发布的代码可以运行,即使其中有错误(请参见下文),也不会引起恐慌(只会使性能变差)。
您发布的堆栈跟踪指示math/rand软件包中的错误,我没有遇到过。请发布完整代码和Go版本+ env(go version和go env)。
math/rand
go version
go env
事实证明,询问者正在RandStringBytesMaskImprSrc()同时从多个goroutines 进行调用。RandStringBytesMaskImprSrc()使用的共享rand.Source实例对于并发使用是不安全的,因此math/rand程序包会出现恐慌。解决方法是rand.Source()为每个goroutine 创建一个单独的例程,并将其传递给RandStringBytesMaskImprSrc()。
RandStringBytesMaskImprSrc()
rand.Source
rand.Source()
开头的“配置”常量存在错误:
const letterBytes = "abcdef0123456789" const ( letterIdxBits = 6 // 6 bits to represent a letter index letterIdxMask = 1<<letterIdxBits - 1 // All 1-bits, as many as letterIdxBits letterIdxMax = 63 / letterIdxBits // # of letter indices fitting in 63 bits )
该常数letterIdxBits应包含表示符号索引所需的位数。由于您使用的字母由16个元素组成(长度为letterBytes),因此16种组合仅需要4位:
letterIdxBits
letterBytes
letterIdxBits = 4 // 4 bits to represent a letter index
测试示例:
var tryArr = make([]string, 10) for i := range tryArr { tryArr[i] = RandStringBytesMaskImprSrc(8) } fmt.Println(tryArr)
输出(在Go Playground上尝试):
[d3e7caa6 a69c9b7d c37a613b 92d5a43b 64059c4a 4f08141b 70130c65 1546daaf fe140fcd 0d714e4d]
(注意:由于Go游乐场的开始时间是固定的,并且输出已缓存,您将始终看到这些随机生成的字符串。在计算机上运行以查看随机结果。)