ProMakeup Opt
wholesale store of cosmetics for the beauty industry, catalog of almost 4,000 items
- Task
- Find out why there are noticeably fewer products in the index than in the catalog.
- Solution
- Bypassing all addresses of the site map that the server gives, comparing them with each other and with the real directory.
- Result
- The canonical site map contains 4,167 addresses — 3,947 products, 166 brands, 47 categories and 6 information pages. Parallel to the standard address lives the old map: 7,782 entries, of which only 2,755 are unique (2,454 addresses are repeated three times) and about 2,706 are marketable. That is, a crawler that follows a standard address sees a duplicated and incomplete directory at the same time. Separately: there is no address of the second language version in the map, although bilingualism is implemented. Measured on 07/31/2026, two consecutive runs gave the same result.