http://glfwtfwhlsm2u5pw3b7crist7bt7fwepj2wgv3n3b64unj22v5435tyd.onion/blog/2022/12/10/The-Incredible-speed-of-memchr.html
These file formats are heavily text-based formats, e.g: fasta, .fastq, .sam, .vcf.
A very typical operation we apply is finding a new line in a huge buffer.
Think of something like: char* str = "ACGTACGTACGTACGTACGTACGT\nACGTACGTACGTACGTACGT\n"
// find the position of the next new line So what is the fastest way of finding these new lines?