Sign up to our newsletter

Welcome to See Through News

Speeding Up Carbon Drawdown by Helping the Inactive Become Active

Local Newspaper Sniff Test & Smell Tests for Effective Climate Action

local newspaper sniff test and smell test

Two diagnostic games to rate your local newspaper’s journalism ethics

The problem with most local newspapers

Our public media awareness campaign, the See Through Newspaper Review Project, outlines the under-reported problem of a handful of conglomerates owning the vast majority of local newspapers.

We explain what’s so dangerous about this stealth corporate takeover, and its negative impact on effective climate action and our Goal of speeding up carbon drawdown.

They key point is that these once-cherished local titles have now been zombified by sacking experienced local journalists living in their communities, and filling the pages with robot-written articles, concealed advertising, and user-generated content.

This articles describes two fun tests See Through News has devised to apply to your local newspaper, and score its journalistic ethics. They expose the space-filling dirty tricks used to blur the line between journalism and advertising.

Like all See Through News projects, these tests are open source, free to use and share, and designed to promote media literacy in a fun, accessible way. They are:

  • The Sniff Test: simple and instant, requiring only a single news article.
  • The Smell Testmore sophisticated, surveying a batch of ten articles at a time.

The See Through News Local Newspaper Sniff Test

 The Sniff Test is designed to determine whether your local paper (and/or website) is: 

  1. a fragrant vibrant local newspaper practising ethical journalism, or
  2. a reeking shrivelled zombie doing corporate advertising
  3. somewhere between these two states

 The 3-step test takes a few minutes, and gets faster with practice. 

  1. Take your local paper’s Top Ten Stories on any given day/issue – most have a handy list in a Daily Briefing email.
  2. Assign one of the Categories to each story.
  3. Tot up the points

The mark out of ten will reveal if your local paper is:

  • A Fragrant Flower. 7-10 Points:

Inhale deeply. Proper ethical local journalism

  • A Bit Whiffy. 4-7 Points

May be on the way out. Hold at arm’s length.

  • A Stinker. 0-3 Points:

Oooft. Bag it before you bin it. 

METHODOLOGY:

Here’s our (provisional) list of categories and points assigned. 1 Point:

  • Human-written original local Content = Local News

0.5 Points

  • Labelled Advertorial = Advertorial
  • Significantly tweaked press release = Journalism?
  • User-Generated Content (i.e. reader-supplied) = UGC
  • Content slightly beyond local scope = Not Local News

0 Points:

  • Untweaked press release/online info = Advertising
  • Bylined press release/online info = Advertising
  • Possible Disguised Advertorial = Advertorial?
  • Content way beyond local scope = Really Not Local News
  • Algorithm-written Content = Robot Article
  • Bylined Robot Article = Fake Journalism

Please try our Sniff Test to score your local newspaper, and post your results here, including a link to the source for peer review.

The Sniff Test and the Smell Test share the same aim. They quickly determine whether your local paper/website is:

  1. a fragrant vibrant local newspaper practising ethical journalism
  2. a reeking shrivelled zombie platform delivering corporate advertising

Now we could have said:

  1. Upholding acceptable ethical standards of journalism
  2. Favouring advertising revenue over editorial integrity

But chose not to, because this is not an academic analysis. There are plenty of those already, all largely ignored. 

We follow the See Through News house style: colourful, playful, straightforward. If we want to engage as broad an audience as possible, we need to follow our strapline: Fun. Friendly. Factful. 

Why Two Tests?

Like Covid tests, our Local News tests come in two versions.

3-Point Sniff Test. The Lateral Flow Test version

  • quick and dirty
  • Requires no expertise or training to administer,
  • Simple, with few moving parts
  • not guaranteed 100% accurate every time, but repeated application reduces the odds of error.

10-Point Smell Test. The PCR-test version

  • the gold standard
  • anyone can have a go, but results improve with experience and training
  • more reliable, sophisticated and nuanced 
  • better at detecting subtle variants.

The 3-Point Local News Sniff Test

Take any news story from your local newspaper/website at random.  Work out if it was it mainly written by:

  1. A Robot
  2. A Non-Journalist Human
  3. A Human Journalist

Assign: 

  • One point for a Robot article.
  • Two points for a Non-Journalist Human article.
  • Three points for a Human Journalist article.

And That’s the Sniff Test Score.  The higher the score, the more ethical the journalism. 

Simple.  

If you’re in any doubt about how to distinguish 1, 2 and 3, read on. More can be found in our Newspaper Review Project Facebook Group, or pilot Review Facebook Group.  

First, let us introduce…

The 10-Point Local News Smell Test. 

The Smell Test uses 8 categories instead of 3, is applied to ten stories instead of one, and delivers a score from 0-10. 

  • The higher the score, the more ethical the journalism.  
  • The lower the score, the more venal the advertising.

Instructions.

  1. Take your local paper’s list of Top Stories on any given day  (many conveniently provide some form of Morning Briefing email)
  2. Assign one of the 8 Categories to each story, each of which carries a score of between 0 and 1 point.
  3. Add up the points from the ten stories, to deliver a mark out of 10.

Our proposed list of Categories, and Points assigned.

How did your local newspaper do?

  • 7-10 Points: Fragrant FlowerAaaaah!. Proper ethical local journalism
  • 4-7 Points: Bit Whiffy:Whoa! Hold at arm’s length.
  • 0-3 Points:

Stinker:

  • Ooft! Bag it before you bin it.

Assigning Categories improves with practice. Once you get used to the idea ,the Sniff Test should take a matter of seconds, and the Smell Test less than 5 minutes.  

For the Smell Test, each article should take a maximum of a minute or so to assess, but many can be done at a glance.  

Now for some top tips on Robot-spotting, and why it matters.

How To Spot a Robot

Written by a Robot’ is a colourful way of saying ‘generated by an algorithm’. 

The main two Robot giveaways are Style and Subject.

Style

As you scan an article, do you some  times find your eyelids dipping, impatient to pick out the relevant numbers, instead of lingering on delightful turns of phrase or local features?

If so, chances are it was written by a robot.

It will be as dull as ditchwater. 

As bland as blancmange.

All the cut-through of a cookie-cutter.

As lively as a lecherous Lothario off his lithium.

Robot journalists can’t yet reliably generate orotund phrases in context. But it won’t be long before they can.

A robot writer is unlikely to use the word ‘orotund’,. If it did, a robot editor would probably replace it with a more common word. ‘Fancy’, maybe. Or ‘florid’.

In this particular case, you and other human editors may agree. But what if all local newspapers end up using the same algorithm?

Would any robot generate a headline like ‘Panic as Man Burns Crumpets’?  That’s the title of a bittersweet memoir recently published by British local news feature writer Roger Lytollis.

The book lays out with painful clarity the transition of the Cumberland News from shining light of local journalism to anodyne advertising platform.

The tipping point was in 2018, when it was taken over by corporate conglomerate Newsquest Media Group Ltd. Newsquest is owned by Gannett, the USA’s #2 local newspaper agglomerator. Gannet is owned by New York private equity group New Media Investment Group. NMIG also owns GateHouse Media, LLC, America’s #1 local newspaper agglomerator.

Such corporations are working with AI developers on robot editors to adjudicate on such matters as using ‘orotund’ or ‘fancy’.

What do you think? How precisely can you draw the line between ‘colourful’ and ‘pompous’?

In isolation, replacing ‘orotund’ with ‘fancy’ may be a good editorial decision in this case, but that’s not the point.

As it improves, AI will get much better at both writing and editing. Robot-spotting will get trickier. Gannett newspapers are already full of robot articles, automating the low-hanging fruit of replacing finance and sports reporters. Why? Money.

  • Slapdash finance and sports hacks working under time pressure tend to paste numbers/scoresheets together with plausible, grammatical sentences.
  • Expensive, ethical, responsible finance and sports reporters selectively use carefully contextualised financial data, or sports stats, to illustrate or support their broader analysis.

Robots are already pretty good at the former. AI boffins are working hard at the latter.

At the cutting edge, GPT-3 developers have opened up the possibility of unleashing such a mega-tsunami of plausible robot-written content, they’re worried it might break the internet.

GPT-3’s developers seem to be trying to keep their genie in the bottle, but the past few thousand years of human history don’t provide many successful examples of controlling technological progress.

Some computational linguists, unimpressed by the ‘intelligence’ displayed by GPT-3’s Big Data form of AI, have dubbed it no more than ‘stochastic parroting’.

GPT-3’s AI credentials may be as irrelevant as its creators efforts to contain it. A few years back a couple of exotic pet parrots escaped their London cages, and now huge flocks of parrots can be seen in the city’s parks. And they’re only real world parrots.

For the moment, Gannett’s bean-counters, and their software engineer sidekicks, appear to have no qualms about the prospect of unleashing a tsunami of poor quality content on the internet.

They’re too busy embracing this exciting new cost-cutting strategy – or as they might put it:

downstream-distributed localised grammatical text incorporating geographically-defined data subsets derived from larger universal datasets with customised geographical fields correlating to the geographical scope of the tasked masthead.

Maybe their robo-editors will replace that with ‘robot-written content’, in the millions of robo-articles with which they flood across the internet..

Subject

For Robot- Spotters, the other giveaway is subject matter.

As Robot articles harvest local data from national datasets, they’re quite easy to spot once you know what to look for.

Any article in your local rag about trends in house prices, crime statistics, or, recently, Covid stats, are probably written by Robot.

If you’ve ever used mail merge features, or dabbled with macros, you’ll get the idea. When you see a headline like:

Local Covid Cases Rocketing

Then imagine something like:

‘[INSERT GEOLOCATION HERE] Covid Cases [IF UPTREND THEN INSERT CHAR STRING =’Rocketing’][IF DEVIATION WITHIN RANGE x THEN INSERT CHAR STRING= ‘ Plateauing’][IF DOWNTREND THEN INSERT CHAR STRING=’Plunging’)

Massive agglomerators, like Gannett, are working with AI developers to cut costs through automation.

This applies to both the ‘curation’ role that used to be filled by editors in selecting relevant stories for an individual reader, and to news articles themselves.

Replace an editor with a robot, and you cut one human salary.  Replace an entire class of reporters, and you could cut hundreds, thousands for the bigger conglomerates of human salaries.

Clearly, this is of interest to the bean-counting hedge funds, now the ultimate owners of so many local titles.  Ignoring such cost-cutting potential would be a dereliction of duty to their investors.

When it comes to replacing reporters with robots, the generation of sports and finance reporting is just the beginning.

They’re basically numbers strung together with grammatical sentences, which current AI is getting quite good at. More topics will follow.

The push behind the automation of journalism is obvious. If you can’t raise revenue, you have to cut costs.

Robots are much cheaper than humans. They work 24/7, don’t get sick or unionise, and are much easier to manage. 

The prose they generate is currently quite easy to spot as it is utterly bereft of vivacity, colour, elan, piquancy, local flavour, or any sense of community/landscape.

Ignore The Byline

The byline is the name of the reporter at the top of the article following the word ‘by’, usually accompanied by a smiling mug shot .

A byline was once valuable journalistic currency.  It meant it was Proper Local News. Real reporters employed by the paper got them, agency reports didn’t.  

For sub-editors writing in their free-time, with dreams of becoming reporters, freelancers looking for their big break, or new recruits desperate to make their name, their first ‘byline’ was a big big deal.

Post-internet, this changed. Knowing that a byline implied authenticity, papers began to plaster them on any old article to boost credibility. 

As advertorials stopped being labelled as such, and advertising began its creeping dominance over journalism, this currency became further devalued.

For a while, a byline retained its basic, most functional meaning – that it was written ‘by’ someone. That someone, increasingly, may have been a corporate PR, but at least they were human.  No longer.

Don’t be fooled by the appearance of a byline and smiling photo adorning the top of a robot-written article. 

As we demonstrate in our pilot Review Group, conglomerates like Gannett no longer have any compunction about pretending robot-written articles were written by humans.

This must be pretty humiliating for the human involved, who’s trained for years as a professional writer. 

Assuming, of course, the person represented by the byline and photograph actually exists.

  • Explain the role these Tests play in our broader scheme, The See Through News Newspaper Review Project.
  • Introduce other See Through News open source media literacy Projects, The Vox Pox Project, How To Live Without Plastic, and The Superhero & Supervillain Drawing Competition.
  • Use case studies to reflect on what we’ve learned from these pilot projects, and how to encourage broad participation, inside and outside educational institutions.