Non-RDS Hash Sets
On this page, we will make links available to data sets that use hashing or digest algorithms not contained in the RDS release. If there is an algorithm or process that you think would be interesting to run on the NSRL file corpus files found in the RDS (or on a subset of files), please contact nsrl@nist.gov .
NOTE: These downloads are being served from the amazon cloud. You may receive a notice that you are leaving the NSRL website.
- Data sets using the ssdeep algorithm (aka "fuzzy hashes")
- Data sets using the sdhash algorithm (aka "similarity digest")
- Data sets using the bulk_extractor tool
SHA1 toSHA 256
A text file which relates SHA-1 to SHA-256 hashes is available.
A 1.1 GB Zip file can be downloaded which contains a 1.9 GB text file with 16,801,737 rows.
Each row has a SHA-1 hash, a tab character, a SHA-256 hash, a tab and a filename. An example of the data can be found here.
The SHA-1 values can be matched to SHA-1 values in RDS 2.41. Note: not all SHA-1 values in RDS 2.41 can be matched to SHA-256 values.
File signatures:
SHA1(rds241-sha256.zip)= 3aa5dc0230444545a817cb9368bbfc28f4105822
MD5(rds241-sha256.zip)= 87542ab5610dc673f4406d0f1c333c9e
SHA1(rds241-sha256.txt)= 1580ecea496a34042f5b9db56e5f02307ffa68b9
MD5(rds241-sha256.txt)= 83234d8f550dd32f8b3706e47d5dd3d9
Note: SHA-256 test data is available.
Hashes of Blocks of Files - MD5 of the first 4096 bytes.
A text file is available which relates the MD5 of a complete file to the MD5 of the first 4096 bytes in the file (provided the file is that large).
A 426 MB Zip file can be downloaded which contains a 823 MB text file with 13,112,687 rows.
Each row has an MD5 hash, a tab character, and an MD5 hash.
Example rows:
File signatures :
SHA1(md5b4096.zip)= dc70683f911d6a6254f37f09418faf0636267f3d
MD5(md5b4096.zip)= c458e36feef54c22226e2ae445e443d0
SHA1(md5b4096.txt)= 57445b7f4dcff3ad62fd05d170bfcc1e80b38b7f
MD5(md5b4096.txt)= ead485222f9f4f7f4a08b050b85d63ef
Hashes of Blocks of Files - MD5 of the first 8192 bytes.
A text file is available which relates the MD5 of a complete file to the MD5 of the first 8192 bytes in the file (provided the file is that large).
A 358 MB Zip file can be downloaded which contains a 638 MB text file with 10,164,753 rows.
Each row has an MD5 hash, a tab character, and an MD5 hash.
Example rows:
File signatures :
SHA1(md5b8192.zip)= 5a6ffcf73f1303caf9b49e35867cca913c173d98
MD5(md5b8192.zip)= 1f810bfa6103ef96c436a749a3d3bc7a
SHA1(md5b8192.txt)= f81203fabb968a5f2f0eec1e228c380798bfbdb1
MD5(md5b8192.txt)= d09c1248ce6780a5cf4e9cc5946e1ebf
Contact
Please send questions or comments to nsrl@nist.gov