Автор |
Dave Dykstra |
Автор |
Lee Lueking |
Дата выпуска |
2010-04-01 |
dc.description |
The CMS detector project loads copies of conditions data to over 100,000 computer cores worldwide by using a software subsystem called Frontier. This subsystem translates database queries into HTTP, looks up the results in a central database at CERN, and caches the results in an industry-standard HTTP proxy/caching server called Squid. One of the most challenging aspects of any cache system is coherency, that is, ensuring that changes made to the underlying data get propagated out to all clients in a timely manner. Recently, the Frontier system was enhanced to drastically reduce the time for changes to be propagated everywhere without heavily loading servers. The propagation time is now as low as 15 minutes for some kinds of data and no more than 60 minutes for the rest of the data. This was accomplished by taking advantage of an HTTP and Squid feature called If-Modified-Since. In order to use this feature, the Frontier server sends a Last-Modified timestamp, but since modification times are not normally tracked by Oracle databases, a PL/SQL program was developed to track the modification times of database tables. We discuss the details of this caching scheme and the obstacles overcome including database and Squid bugs. |
Формат |
application.pdf |
Издатель |
Institute of Physics Publishing |
Копирайт |
© 2010 IOP Publishing Ltd |
Название |
Greatly improved cache update times for conditions data with Frontier/Squid |
Тип |
paper |
DOI |
10.1088/1742-6596/219/7/072034 |
Electronic ISSN |
1742-6596 |
Print ISSN |
1742-6588 |
Журнал |
Journal of Physics: Conference Series |
Том |
219 |
Первая страница |
72034 |
Последняя страница |
72039 |
Аффилиация |
Dave Dykstra; Computing Division, Fermilab, Batavia, IL, USA |
Аффилиация |
Lee Lueking; Computing Division, Fermilab, Batavia, IL, USA |
Выпуск |
7 |