Book scanning

Internet Archive Scribe book scanner in 2011
Internet Archive book scanner

Book scanning or book digitization (also: magazine scanning or magazine digitization) is the process of converting physical books and magazines into digital media such as images, electronic text, or electronic books (e-books) by using an image scanner. Large scale book scanning projects have made many books available online. Digital books can be easily distributed, reproduced, and read on-screen. Image scanners may be manual or automated. After scanning, software adjusts the document images by lining it up, cropping it, picture-editing it, and converting it to text and final e-book form. Scanning resolution for book digitization varies depending on the purpose and nature of the material. High-end scanners capable of thousands of pages per hour can cost thousands of dollars. Projects like Project Gutenberg, Million Book Project, Google Books, and the Open Content Alliance scan books on a large scale. Image scanners may be manual or automated.

Description

[edit]

Book scanning is the process of converting physical books and magazines into digital media such as images, electronic text, or electronic books (e-books) by using an image scanner.[1] Large scale book scanning projects have made many books available online.[2]

Use

[edit]

Digital books can be easily distributed, reproduced, and read on-screen. Common file formats are DjVu, Portable Document Format (PDF), and Tag Image File Format (TIFF). To convert the raw images optical character recognition (OCR)[1] is used to turn book pages into a digital text format like ASCII or other similar format, which reduces the file size and allows the text to be reformatted, searched, or processed by other applications.[1]

Image scanners may be manual or automated. In an ordinary commercial image scanner, the book is placed on a flat glass plate (or platen), and a light and optical array moves across the book underneath the glass. In manual book scanners, the glass plate extends to the edge of the scanner, making it easier to line up the book's spine.[1][2]

Software

[edit]

After scanning, software adjusts the document images by lining it up, cropping it, picture-editing it, and converting it to text and final e-book form. Human proofreaders usually check the output for errors.[citation needed]

Resolution

[edit]

Scanning resolution for book digitization varies depending on the purpose and nature of the material. While 300 dpi (118 dots/centimeter) is generally adequate for text conversion, archival institutions recommend higher resolutions for preservation and rare materials. The National Archives of Australia suggests 400 ppi for bound books and 600 ppi for rare or significant documents,[3] while the Federal Agencies Digitization Guidelines Initiative (FADGI)[4] recommends a minimum of 400 ppi for archival materials.[5]

These higher resolutions ensure the capture of fine details and support long-term preservation efforts, while a tiered approach balances quality with practical constraints such as storage capacity and resource limitations. This strategy allows institutions to optimize digitization efforts, applying higher resolutions selectively to rare or significant materials while using standard resolutions for more common documents.[6]

Book scanners

[edit]
The CZUR M3000 book scanner features a V-shaped cradle that protects books during scanning, ensuring their preservation.
czur of a V-shaped book scanner
Sketch of a typical manual book scanner

High-end scanners capable of thousands of pages per hour can cost thousands of dollars, but do-it-yourself (DIY), manual book scanners capable of 1,200 pages per hour have been built for US$300.[7]

Commercial book scanners

[edit]

Commercial book scanners are not like normal scanners; these book scanners are usually a high quality digital camera with light sources on either side of the camera mounted on some sort of frame to provide easy access for a person or machine to flip through the pages of the book. Some models involve V-shaped book cradles, which provide support for book spines and also center book position automatically.

The advantage of this type of scanner is that it is very fast, compared to the productivity of overhead scanners.

Large-scale projects

[edit]

Projects like Project Gutenberg (est. 1971),[8] Million Book Project (est. circa 2001), Google Books (est. 2004), and the Open Content Alliance (est. 2005) scan books on a large scale.[9][10]

One of the main challenges to this is the sheer volume of books that must be scanned. In 2010 the total number of works appearing as books in human history was estimated to be around 130 million.[11] All of these must be scanned and then made searchable online for the public to use as a universal library. Currently, there are three main ways that large organizations are relying on: outsourcing, scanning in-house using commercial book scanners, and scanning in-house using robotic scanning solutions.

As for outsourcing, books are often shipped to be scanned by low-cost sources to India or China. Alternatively, due to convenience, safety and technology improvement, many organizations choose to scan in-house by using either overhead scanners which are time-consuming, or digital camera-based scanning machines which are substantially faster and is a method employed by Internet Archive as well as Google.[10][12] Traditional methods have included cutting off the book's spine and scanning the pages in a scanner with automatic page-feeding capability, with subsequent rebinding of the loose pages.[13]

Once the page is scanned, the data is either entered manually or via OCR, another major cost of the book scanning projects.[according to whom?]

Due to copyright issues, most scanned books are those that are out of copyright; however, Google Books is known to scan books still protected under copyright unless the publisher specifically prohibits this.[9][10][12][14]

Collaborative projects

[edit]

There are many collaborative digitization projects throughout the United States. Two of the earliest projects were the Collaborative Digitization Project in Colorado and NC ECHO – North Carolina Exploring Cultural Heritage Online,[15] based at the State Library of North Carolina.

These projects establish and publish best practices for digitization and work with regional partners to digitize cultural heritage materials. Additional criteria for best practices have more recently been established in the UK, Australia and the European Union.[16] Wisconsin Heritage Online[17] is a collaborative digitization project modeled after the Colorado Collaborative Digitization Project. Wisconsin uses a wiki[18] to build and distribute collaborative documentation. Georgia's collaborative digitization program, the Digital Library of Georgia,[19] presents a seamless virtual library on the state's history and life, including more than a hundred digital collections from 60 institutions and 100 agencies of government. The Digital Library of Georgia is a GALILEO[20] initiative based at the University of Georgia Libraries.

In the twentieth century, the Hill Museum and Manuscript Library photographed books in Ethiopia that were subsequently destroyed amidst political violence in 1975. The library has since worked to photograph manuscripts in Middle Eastern countries.[21]

In South Asia, the Nanakshahi trust is digitizing manuscripts of Gurmukhī script.

In Australia, there have been many collaborative projects between the National Library of Australia and universities to improve the repository infrastructure that digitized information would be stored in.[22] Some of these projects include, the ARROW (Australian Research Repositories Online to the World) project and the APSR (Australian Partnership for Sustainable Repository) project.

Methods

[edit]

Image scanners may be manual or automated. In an ordinary commercial image scanner, the book is placed on a flat glass plate (or platen), and a light and optical array moves across the book underneath the glass. In manual book scanners, the glass plate extends to the edge of the scanner, making it easier to line up the book's spine.[1][2]

Scanning preparation

[edit]

A problem with scanning bound books is that when a book that is not very thin is laid flat, the part of the page close to the spine (the gutter) is significantly curved, distorting the text in that part of the scan. One solution is to separate the book into separate pages by cutting or unbinding. A non-destructive method is to hold the book in a V-shaped holder and photograph it, rather than lay it flat and scan it. The curvature in the gutter is much less pronounced this way.[23] Pages may be turned by hand or by automated paper transport devices. Transparent plastic or glass sheets are usually pressed against the page to flatten it.

Destructive scanning methods

[edit]

For book scanning on a low budget, the least expensive way to scan a book or magazine is to cut off the binding. This converts the book or magazine into a sheaf of separate sheets which can be loaded into a standard automatic document feeder (ADF) and scanned using inexpensive and common scanning technology. The method is not suitable for rare or valuable books. There are two technical difficulties with this process, first with the cutting and second with the scanning.

Unbinding

[edit]

More precise and less destructive than cutting pages is to unbind by hand using suitable tools. This technique has been successfully employed for tens of thousands of pages of archival original paper scanned for the Riazanov Library digital archive project from newspapers and magazines and pamphlets, varying from 50 to 100 years old and more, and often composed of fragile, brittle paper. Although the monetary value for some collectors (and for most sellers of this sort of material) is destroyed by unbinding, it in many cases actually greatly assists preservation of the pages, making them more accessible to researchers[1] and less likely to be damaged when subsequently examined. A disadvantage is that unbound stacks of pages are "fluffed up", and therefore more exposed to oxygen in the air, which may in some cases speed deterioration. This can be addressed by putting weights on the pages after they are unbound, and storage in appropriate containers.[1]

Turning the pages in between taking scans

Robotic book scanners

[edit]
Video of the robotic book scanner
Robotic V-shaped Book Scanner

A robotic or automated book scanner is a device that digitizes printed books by using robotic systems to turn pages and capture images of each page without the need for human hands to touch the book. The scanner consists of a mechanism to automatically turn pages, one or more cameras to photograph each page, and software to compile these images into a digital file. These scanners are used to digitize large quantities of books quickly. Some models allow for manual operation if a book is too delicate or complex for the robot to handle alone. The process is designed to be gentle on books, often using special cradles and glass plates to avoid damage during scanning.[24]

Most high-end commercial robotic scanners use air and suction technology to turn and separate pages. These scanners utilize a vacuum or air suction to gently lift a page from the stack, while a puff of air is used to turn the page over, allowing the device to scan both sides efficiently.[25] Some use newer approaches such as bionic fingers for turning pages. Some scanners take advantage of ultrasonic or photoelectric sensors to detect dual pages and prevent skipping of pages.[1][2] With reports of machines being able to scan up to 2,900 pages per hour,[26] robotic book scanners are specifically designed for large-scale digitization projects.[1]

Google's patent 7508978 shows an infrared camera technology which allows detection and automatic adjustment of the three-dimensional shape of the page.[27][28] Robotic book scanners that use air and suction technology rely on specialized systems to turn and separate pages without causing damage to fragile or rare books. These scanners utilize a vacuum or air suction to gently lift a page from the stack, while a puff of air is used to turn the page over, allowing the device to scan both sides efficiently

See also

[edit]

References

[edit]
  1. ^ a b c d e f g h i "6 Factors to Consider while Digitizing Books at Scale". hurixdigital. July 22, 2019. Archived from the original on January 17, 2022. Retrieved October 17, 2022.
  2. ^ a b c d Harman, Mike (March 23, 2021). "An 8-Step Guide to Digitization for Book Publishers". Kitaboo. Archived from the original on January 22, 2022. Retrieved October 17, 2022.
  3. ^ "Preservation Digitisation Standards" (PDF). NAA. Retrieved 28 February 2025.
  4. ^ Federal Agencies Digitization Guidelines Initiative (FADGI)
  5. ^ "Technical Guidelines for Digitizing Cultural Heritage Materials" (PDF). FADGI. Retrieved 28 February 2025.
  6. ^ "Digitising the Queensland Ambulance Service Museum Archive: Preserving History for Future Generations". Avantix. August 2024. Retrieved 28 February 2025.
  7. ^ "DIY High-Speed Book Scanner from Trash and Cheap Cameras". instructables.com. Retrieved 19 January 2014.
  8. ^ "Libraries & Archivists Are Digitizing 480,000 Books Published in 20th Century That Are Secretly in the Public Domain". Open Culture. September 27, 2019. Archived from the original on October 2, 2019. Retrieved October 19, 2022.
  9. ^ a b Leetaru, Kalev (2008). "Mass book digitization: The deeper story of Google Books and the Open Content Alliance". First Monday. doi:10.5210/fm.v13i10.2101. Retrieved October 19, 2022.
  10. ^ a b c Kahle, Brewster (March 13, 2017). "Transforming Our Libraries from Analog to Digital: A 2020 Vision". Educause. Archived from the original on March 15, 2017. Retrieved October 19, 2022.
  11. ^ Taycher, Leonid (2010-08-05). "As of Aug 5, 2010, google estimates that there are 129,864,880 different books in the world". Googleblog.blogspot.co.at. Retrieved 2014-08-08.
  12. ^ a b Howard, Jennifer (August 10, 2017). "What Happened to Google's Effort to Scan Millions of University Library Books?". EdSurge. Archived from the original on January 5, 2022. Retrieved October 17, 2022.
  13. ^ Hafner, Katie (22 October 2007). "Libraries Shun Deals to Digitize Books". The New York Times. Retrieved 25 November 2025.
  14. ^ Somers, James (April 20, 2017). "Torching the Modern-Day Library of Alexandria". The Atlantic. Archived from the original on April 20, 2017. Retrieved October 19, 2022.
  15. ^ "North Carolina ECHO : Exploring Cultural Heritage Online". ncecho.org.
  16. ^ Awre, Chris (April 30, 2005). "Digital Libraries: Principles and Practice in a Global Environment". Ariadne (43). Archived from the original on April 5, 2022. Retrieved October 19, 2022.
  17. ^ "Recollection Wisconsin". 29 November 2006.
  18. ^ "Wisconsin Heritage Online [licensed for non-commercial use only] / FrontPage". pbworks.com.
  19. ^ "Welcome to the Digital Library of Georgia". usg.edu.
  20. ^ "GALILEO". usg.edu.
  21. ^ "Codices decoded". The Economist. 18 December 2010. p. 151.
  22. ^ Libraries in the twenty-first century: Charting new directions in information services. Edited by Stuart Ferguson, 2007, pg 84
  23. ^ JThomas (April 2012). "A Scanner for books with text VERY close to the gutter". DIY Book Scanner.
  24. ^ Sinmaz, E. K., Kocaseçer, M., & Ayyildiz, M. (2022). The Effect of Book Preconditioning on Page-Turning Success Rate during Automated Book Digitization. Instruments & Experimental Techniques, 65(5), 826–833. https://doi.org/10.1134/S0020441222050281
  25. ^ mchamberlin (2025-03-26). "McFarlin's new ScanRobot protects rare books while increasing access for students, scholars". The University of Tulsa. Retrieved 2025-05-29.
  26. ^ Rapp, David. "Product Watch: Library Scanners". Library Journal. Archived from the original on 12 May 2014. Retrieved 11 May 2014.
  27. ^ US 7508978, Lefevere, Francois-Marie & Saric, Marin, "Detection of grooves in scanned images", issued March 24, 2009, assigned to Google 
  28. ^ The Secret Of Google's Book Scanning Machine Revealed, by Maureen Clements, April 30, 2009.
[edit]