Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 457784 - /data/cached/buglist-*.html missing last-modified timestamps
Summary: /data/cached/buglist-*.html missing last-modified timestamps
Alias: None
Product: Gentoo Infrastructure
Classification: Unclassified
Component: Bugzilla (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Bugzilla Admins
Depends on: 457782
  Show dependency tree
Reported: 2013-02-16 03:02 UTC by Daniel Santos
Modified: 2021-08-25 21:11 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Note You need to log in before you can comment on or make changes to this bug.
Description Daniel Santos 2013-02-16 03:02:56 UTC
Entries in /data/cached/buglist-*.html do not include a last-modified timestamp.  Therefore, if the bugs were actually accessible (see bug #457782), bots would have to read each bug report each time it crawled the site, resulting in much greater server load than necessary.

Perhaps a better solution would be to generate a compressed sitemap.xml to replace the current buglist-*.html files.  This has many advantages, one of which is that robots will know which bug reports are stale in its cache and which are still good and, thus, only download bugs reports which have been modified.  Additionally, the bandwidth, I/O & CPU load on the server will be reduced, as the compressed file will be smaller than an uncompressed html.
Comment 1 Alec Warner (RETIRED) archtester gentoo-dev Security 2021-08-25 21:11:24 UTC
This is 8 years old, please re-open if its an actual problem for you.