SA farm murder stats: How the wrong figure became ‘fact’

JOHANNESBURG — This below analysis should form the base of a case study of how a misguided interpretation of statistics can result in a skewed and unrealistic picture of what's really happening on the ground. It makes the job of journalists in today's world that much more important as they need to critically think about the statistics they report on before hitting the publishing button. (The analysis below first appeared in Politicsweb and is republished here with permission.) – Gareth van Zyl.By The Ratcatcher.On Tuesday this week Police Minister Bheki Cele released the South African Police Service's crime statistics for 2017/2018. The information contained in the SAPS' presentation detonated a small explosion beneath a claim repeatedly made, over the past month, by some of the world's most prestigious newspapers, authoritative "Fact Checkers", and most brilliant diplomats. How this came to pass is an interesting case study in how, in our current age, a falsity can still travel halfway around the world, and back again, long after the truth has put its boots on and kicked the damn thing to death..The story begins with a reply to a parliamentary question from Freedom Front leader Pieter Groenewald MP by the Minister of Police on the 3rd of May 2018. In it Bheki Cele provided detailed data from the SAPS on the provincial breakdown of farm murders and farm attacks by year from 2012/13 to 2017/18. This was useful information as it suggested that the burden of this type of crime fell disproportionally on farms and small holdings in the eastern half of the country, and that any analysis of this phenomenon needed to take this into account..The figures were not unproblematic however. The national totals for farm murders in the 2015/16 and 2016/17 periods were significantly lower than official figures earlier released by SAPS. The figure of 47 farm murders for the 1 April 2017 to 31 March 2018 period (down from 74 the year before) also seemed implausibly low. One likely explanation for this was simply that the figures had been compiled only a month after the end of the reporting year, and were not complete. As Sally de Beer of the SAPS had told Africa Check the year before "the database is a 'live' system, meaning that the statistics derived from it are subject to change if new information on cases emerges. The database is not primarily intended as a source of statistics, but as an operational tool." The fact-checking site cautioned in its 2017 fact-sheet on this issue that, "As such, statistics for certain years may change." There was thus good reason not to put any weight on this last, probably provisional, national figure..Then on the 31st May 2018 Agri SA released a report on farm attacks. This contained the following graph:.The source given for the data is clearly "SAPS" (see arrow). The person compiling the graph had merged the data provided to Pieter Groenewald at the beginning of the month with other previously released SAPS statistics. Where they conflicted – for 2015/16 and 2016/17 – Agri SA went with the significantly lower figures from May. The Agri SA report commented: "When police statistics, as announced in Parliament for the past six years, are viewed more closely, it appears that farm attacks had increased while murders declined on a year-on-year basis." The number of "47" is contained in the graph, but not in the text of the report..Despite Agri SA's clear admonition to "treat farm attack statistics with caution", News24 ran a massively hyped-up story the same day asserting that "Farm murders have decreased to their lowest level in more than 20 years, a report by agricultural organisation AgriSA has found." It made the claim that "According to AgriSA's statistics, farm murders decreased from 66 recorded incidents in 2016/2017 to 47 in 2017/2018. This was less than a third of the record highs recorded in the late 1990s, when 153 murders were recorded in 1997/1998." In this way the questionable SAPS numbers released earlier that month were now magically transformed into gold standard statistics from Agri SA..As a Ratcatcher article (published within hours of the News24 report first appearing) noted, the SAPS data Agri SA had used for the past three years was not reliable, and the figure of "47" for 2017/18 was simply wrong. A quick and dirty analysis of the SAPS figures for three provinces revealed at least eight clear cut farm murder cases, reported in the press, which could not have been included in these figures. The article noted:."Given that a brief news search could establish eight cases missed by the SAPS the true under-count must be substantial. The SAPS figures should also be more not less comprehensive than press reporting. The News24's headline then is based upon a SAPS figure which was implausible to begin with, and which is provably wrong.".AfriForum, which collects its own data on farm murders and farm attacks, also vehemently disputed this figure..The assertion that there were only 47 farm murders in 2017/18 and therefore at their "lowest level in more than 20 years", should have been quietly buried, and left to rest in peace from then on..Rise of a zombie factoid.In late June 2018 however Jason Burke of the Guardian of London decided to disinter this claim, and the number on which it was based. In an article on the 27th June 2018 he stated that "Forty-seven farmers were killed in 2017-18, according to statistics compiled by AgriSA, an association of hundreds of agricultural associations across South Africa … The new lower totals contradict recent reports in Australian and other western media describing white farmers in South Africa facing "a surge in violence'.".The opening sentence of Burke's piece contained three factual errors. It conflated farm murders with murders of farmers (not always the same thing), cited a figure that had been already shown to be false (47), and claimed that these statistics had been compiled by Agri SA (they were from the SAPS)..This zombie-like factoid – that farm murders were at a "twenty year low" – began massively replicating itself after US President Donald Trump tweeted, following a Fox News broadcast by Tucker Carlson on looming land seizures in SA, that he had "asked Secretary of State @SecPompeo to closely study the South Africa land and farm seizures and expropriations and the large scale killing of farmers." In the subsequent rush to debunk Trump's comments on farm murders this claim was repeatedly invoked by US and British publications, often linking back to Burke's Guardian article as the source..For example an article in the New York Times on the 23rd August 2018 by Kimon de Greef and Palko Karasz stated that: "The number of killings of farmers, including farm workers, is at a 20-year low, 47 in the fiscal year 2017-18, according to research published in July by AgriSA, a farmers' organization in South Africa." This same claim was then repeated in an editorial in the publication denouncing Trump, which added that the "numbers have been declining steadily since peaking in 1998, when 153 were killed.".In an article for the Financial Times Joseph Cotterill stated that "Agri SA, a farmers' organisation, said in May that farm murders were at their lowest level in two decades. There were 47 murders between 2017 and 2018 compared with 66 over the previous period, it said.".It was also credulously accepted by the American and British Fact-Checking establishment..The Washington Post Fact Checker wrote that "the government's farm-murder statistic has been declining steadily from its peak in 2001-2002, when the total was 140. Separate figures from Agri SA show that murders of farmers are at a 20-year low, with 47 recorded in the year from April 2017 to March 2018 period, the Guardian reported.".The BBC's "Reality Check" claimed that "AgriSA, an association of agricultural organisations, also records murders and attacks on farms. It found that in the year to April 2018, there were 47 murders, with their data showing a decline from a high in 1998, when 153 people were killed.".Politifact repeated the claim that "there were 47 farm murders in the 2017-18 financial year" and they "have been declining over time." But to its (partial) credit it correctly attributed the source of this information to the SAPS, not AgriSA..The internet myth-busting website Snopes meanwhile reposted the AgriSA graph above and also stated that "the number of farm murders in South Africa hit a 30-year low point in 2017-18, according to a report released by the South African Agricultural Industry (AgriSA) that cited South African police data.".Then, at the end of August, Foreign Policy ran an article headlined "In Tacit Rebuke, U.S. Embassy in South Africa Rejects Trump Tweet: Internal cable cites report that farm murders in South Africa are at their lowest level in 19 years". Robbie Gramer and Colum Lynch reported on the contents of a leaked cable to Washington DC from US diplomats in South Africa which was headed ""Despite Crime Epidemic, Farm Murders Down." The authors reported that the cable had "cited a recent report by AgriSA, a nonprofit industry group that represents 70,000 commercial farmers, that estimated that there were 47 farm murders from 2017 to 2018, fewer than at any time in the past 19 years.".None of these journalists, diplomats or Fact Checkers though it worth cautioning that the number of 47 had long been shown (by a body-count) to be too low, or even that it was contested. Although implausible to begin with – and long disproven by the time it started feasting on the brains of British and American intellectuals – this factoid was apparently too convenient not to unleash upon readers as well. It was further invested with bogus authority by simply asserting that the number came from Agri SA, rather than highly provisional police figures. News24's hyped up interpretation of Agri SA's somewhat more cautious analysis were also presented as reflecting the latter organisation's own view..End of an error.On Tuesday the South African Police Service, during their press briefing, released updated figures for the number of recorded farm murders (though not attacks) for 2017/18. The SAPS presentation stated that there were, in fact, 62 farm murders last year, not 47. The SAPS added that 42 of the murders occurred on farms, 15 on small holdings and one at a cattle post. 46 victims were white. If one compares the provincial breakdown with the information released on the 3rd May there was an under-count of eighteen murders in eight provinces (three of which had been identified by the Ratcatcher) and an over-count of three in one (the North West.).SAPS statistics for the number of farm murders in the 1st April 2017 to 31st March 2018 time period:.Province3rd May 2018 provisional SAPS figures9 September 2018 official SAPS figuresDifferenceGauteng912+3KZN57+2Mpumalanga38+5ECape23+1WCape13+2NCape13+2NWest129-3Limpopo79+2FState78+1National4762+15.In a statement released yesterday Agri SA accepted the new figures, noting that "it is worrying that 62 farm murders occurred during 2017/2018. It is 15 murders more than what was announced in parliament earlier this year." The number of 62 farm murders is down from last year's spike of 74, but it is still above the lowest figure ever recorded by SAPS, which was 56 in 2011/12. See graph below..In other words this most recent data completely blows up what remains of the factual basis for the claim that the number of farm murders in 2017/18 in South Africa was at its "lowest point in twenty years". Though substantially down from its peak in the late 1990s the recent trend in terms of farm murders and more especially attacks has also clearly been upwards..Note: In interpreting the meaning of this graph above, over time, one should also tread carefully given that the number of commercial farmers has declined dramatically post-1994. Among a number of push factors has been the lack of personal security on vulnerable farms, economic factors such as the withdrawal of all state support, and government's land redistribution and restitution programmes. There is also a three year gap in the SAPS data between 2007 and 2009. It is also not completely clear whether the pre-2007 SAPS series is fully comparable with the post-2010 one.

SA farm murder stats: How the wrong figure became ‘fact’

Related Stories

The Economist – The Arctic: Climate change’s great economic opportunity

How this boomer realised TikTok’s power through ‘The Digger Girl’ – Marc Champion

Proposed R100bn Transformation Fund is unconstitutional: Anthea Jeffery

US Presidential Election: Trump wins after securing Penn, Georgia, N Carolina