RPICPI User Group

last person joined: 3 months ago 

To foster co-operation and the exchange of information between the ONS, its advisory bodies and other users. Please see 'Aims of the RPI/CPI User Group' in the library for further details.

Web scraping project update

  • 1.  Web scraping project update

    Posted 04-09-2017 11:49


    On Friday we published a summary of the ongoing research into using web scraped price data in the production and development of consumer price statistics. The aim of the report was to summarise all the work carried out since the project began in 2014 as a useful "one-stop shop" reference, so there are sections where you may already be familiar with some of the work (for example, some of the methodology section and clothing data - where the full reports were also published recently). However, there is also new information contained within the grocery prices project section and we have also included some information about the central collections feasibility study that we are currently undertaking, which looks at whether it would be possible to use web scraped data to supplement the collection of items that are currently done by price collectors at ONS. We would welcome input from our users on any of the issues raised within the paper.

    Best wishes,
    Tanya (ONS)

  • 2.  RE: Web scraping project update

    Posted 01-08-2018 17:08
    Guy Nason, Professor of Statistics at the University of Bristol has requested the following paper, which discusses the use of web-scraped price data and which he co-authored be added to the library -

    Powell, B, Nason, G, Elliott, D, Mayhew, M, Davies, J & Winton, J, 2018, 'Tracking and modelling prices using web-scraped price microdata: towards automated daily consumer price index forecasting'. Journal of the Royal Statistical Society: Series A, vol 181., pp. 737-756

    Tony Cox
    chair, RPI CPI User Group