Tel Aviv's Digital Archives Are Drowning in Duplicate Images — and the Numbers Are Alarming

Tel Aviv's municipal digital infrastructure is carrying a hidden weight. An internal review process launched by the Tel Aviv-Yafo Municipality's Digital Services Unit in early 2026 has identified more than 47,000 duplicate image files spread across the city's public-facing archival platforms — a problem that has quietly inflated storage costs, slowed search response times, and buried original photographs under layers of near-identical copies.

The timing matters. The municipality has been mid-way through a NIS 28 million digitisation drive, a multi-year programme to migrate physical records, neighbourhood planning documents, and heritage photography into accessible online databases. Duplicate image proliferation is now threatening the return on that investment, according to documentation reviewed by The Daily Tel Aviv. When the same file gets ingested multiple times — through scanner re-runs, department uploads, or automated sync errors — it does not just waste space. It fragments search results, misleads archivists, and forces human reviewers to spend hours manually cross-referencing entries that a clean database would surface in seconds.

Where the Problem Lives

Two institutions sit at the centre of the duplication crisis. The Eretz Israel Museum in Ramat Aviv holds one of the country's largest photographic collections documenting early Tel Aviv, and its digital catalogue — accessible through the National Library of Israel's online portal — has been flagged for containing duplicate scans of glass-plate negatives from the 1920s and 1930s, some appearing as many as four separate times under different metadata tags. Across town, the Tel Aviv-Yafo Municipal Archive on Ibn Gabirol Street manages building permits, aerial surveys, and neighbourhood maps. Staff there have been working since March 2026 with a deduplication software tool to clean image libraries folder by folder — a process estimated to take at least another eight months to complete.

The Florentine and Neve Tzedek neighbourhoods, both subject to active heritage preservation orders, have generated particularly dense duplicate clusters. Repeated photographic surveys commissioned by different city departments — urban planning, heritage conservation, and the local district committees — produced overlapping image sets that were each uploaded independently. By one internal estimate shared with municipal councillors in May 2026, Neve Tzedek documentation alone accounts for roughly 3,200 redundant files.

The Cost in Shekels and Hours

Storage is not free. The municipality currently pays for cloud archiving through a government-framework contract, and the price per terabyte has risen. Redundant data does not sit inertly — it is backed up, replicated across nodes, and indexed. The Digital Services Unit's own working paper, dated February 2026, estimated that duplicate image files account for approximately 18 percent of total municipal archival storage consumption. Eliminating confirmed duplicates, the paper projected, could cut the relevant storage bill by NIS 340,000 annually.

Labour costs compound the figure. Archivists and digital cataloguers at the municipal level earn roughly NIS 12,000 to NIS 16,000 a month. The unit calculated that staff across relevant departments collectively spend around 1,100 hours per year on manual duplicate-related tasks — cross-checking, deletion approvals, and metadata reconciliation. At mid-range salary rates, that translates to an additional NIS 200,000 in absorbed personnel costs each year.

The deduplication software now being piloted, procured under a NIS 180,000 annual licence, uses perceptual hashing — a technique that identifies visually identical or near-identical images even when file names and metadata differ. Early results from the Ibn Gabirol archive pilot showed a 92 percent match-accuracy rate on a test batch of 5,000 files, with a false-positive rate of under 1.5 percent.

For residents, heritage researchers, and urban planners who rely on the city's digital records, the practical upshot is straightforward. The municipality plans to open a cleaned version of the Neve Tzedek and Florentine photographic catalogues to public search by the fourth quarter of 2026. Anyone currently using the Eretz Israel Museum's digital portal and finding duplicate entries is advised to report discrepancies directly to the museum's collections department, which is coordinating with the National Library of Israel on a joint deduplication pass scheduled to begin in September. The city's Digital Services Unit has also published a guidance document for district committees on image-capture protocols designed to prevent the same problem from regenerating as new surveys proceed.