Post

We've been getting a lot of questions about how the Internet Archive digitizes books. The short answer: page by page, by hand. You may remember our viral 2021 video of Eliza Zhang scanning a book. That's still how we do it. Meet Eliza, and learn how we scan books: blog.archive.org/2021/02/09/m...

1.3K reposts4.2K likes

Sadly, there archive seems to have lost 100s of public domain books from the late 1800s and early 1900s... And in many old books with fold out tipped in illustrations, your hand process failed to digitize pages. Luckily, I downloaded stuff years ago for my own historical reference

Haven't been able to my scanner software active. May I have one of these, please. I'll gladly contribute anything I find that isn't in the archive.

So I've heard. I've also heard that by 'rare' is meant 'out of print'. If a book was actually an antique it would be more valuable left untouched, and nobody in their right mind would destroy it. Most of these 'reports' are fueled by irrational fears of technology, and by social media trendiness.

It's also about volume, destructive scanning is much, much faster, and for the amount of data they're moving using something this slow would pretty much be impossible. Don't get me wrong, destroying books is asinine but if the target is speed cutting the spine and going from there is what we got rn

I got paid really well to digitize a business's records for about a year. Why was I getting paid 75 bucks an hour? Because it was the most tedious boaring shit you could possibly imagine and would have driven others insane, lol. Just loading and unloading a fujitsu scanner all day and naming files.

That is true. I was dealing with peoples medical records so it was incredibly important everything was correctly formatted and easy to search. It all felt first nature to me so I guess I undersold the attention to detail required when building a database.

Thanks for doing it the right way. It’s a crime against humanity that these trillion dollar companies are destroying rare books in the name of enhancing shareholder value

this must be such a tedious process, but also, this is clearly a highly optimized workflow and I respect that y'all are doing the greatest of services for humankind and I have immense respect for your work

I worked in a 'copy center' for a while a long time ago, and as long as you don't care about the quality, you can do it a lot quicker by taking the books apart (just cutting off the bindings) and sending them through high-speed copiers, which is what 'AI scanning for training' is all about!

This is a lot more elegant of a solution vs AI Companies cutting off the spline, scanning the pages, and trashing the original material.

But it’s also a lot more labor-intensive and, depending on the book, not always worth it. An AI company bought our local library’s outdated stock, books that had already been sorted out and marked for destruction anyway.

I think it's outrageous that AI gets to train on copy righted material. I think it outrageous that their data centers raise our electric bills, stress our grids, poison our air, and suck up our water. Them having to pay a slave wage hypothetically is among the least outrageous shit.

How about instead of bragging about this, you give us some information about why the Wayback Machine (aka the main reason people use your site) is down.