Data reporting

Data reporting is the process of collecting and submitting data which gives rise to accurate analyses of the facts on the ground; inaccurate data reporting can lead to vastly uninformed decision-making based on erroneous evidence. When data is not reported, the problem is known as underreporting; the opposite problem leads to false positives.

Data reporting can be an incredibly difficult endeavor. Census bureaus may hire even hundreds of thousands of workers to achieve the task of counting all of the residents of a country.^[1][2] Teachers use data from student assessments to determine grades; cellphone manufacturers rely on sales data from retailers to point the way to which models to increase production of. The effective management of nearly any company relies on accurate data.

Problems arising from poor data reporting

Poor data reporting leads to flawed information in the hands of decision-makers and journalists, especially when they fail to scrutinize the data and blindly trust the assertions of the data reporters. For example, poor data reporting from a crowd-sourced website led to a highly incorrect article by FiveThirtyEight.

Hickey' debut article for the site, which ironically used unreliable data in an example about properly interpreting statistics, attempted to determine the entrée item at McDonald's that provided the highest calorie count for the money. The mathematical techniques that he used (dividing the calorie total by the price) were flawless, as were the calorie counts, which McDonald's provides as the law requires and which serve as an example of accurate data reporting.^[3] However, when Hickey looked to collect data on prices at McDonald's, he relied on a website^[4] that in turn relied on unpaid "crowd-sourced" data reporting.

Hickey's data reporting was inaccurate, including the improbable assertion that a two-patty cheeseburger cost less than a one-patty cheeseburger. Since Hickey failed to review or scrutinize the incorrectly reported data, his analysis failed on multiple levels, leading to several blatantly false conclusions. After publication, reader complaints convinced Hickey to insert a correction for the prices of one of the burgers, but he failed to notice any of the other errors in his article. As none of the site's editors (including noted statistician Nate Silver) caught the error, the inaccurate analysis remained and indeed still remains available online.^[5]

References