research


Search engine tricks for researchers

On several occasions, when I’ve researched a topic that has just hit the news, search engines have shown me nothing but news articles on commentary on that event. Usually it’s 20 versions of the same syndicated article. Finding background information becomes nearly impossible. Google’s weighting heavily favors recently added or changed pages.

Fortunately, if you know Google’s options well, there are ways to get around this. They also work with Startpage, which is an independent privacy-protecting front end to Google. I recommend Startpage, if only to avoid Google’s diddling with your search results based on what it knows about you. Startpage recently dropped its advanced search page, but you can still do everything it let you do.
(more…)


The black swan fallacy

A while ago I ran into a report of an alleged side effect of the COVID-19 vaccine. It was a “this happened to my cousin” story, so it’s low on credibility. Some news outlets, though, claimed it couldn’t be true because there was no previous report of this effect.

That’s not a valid refutation. The vaccines are fairly new, and it’s plausible that a few people could have side effects that weren’t previously recorded. The media argument amounted to “We never heard of it before, so it couldn’t have happened.”
(more…)


Disagreement isn’t refutation

Websites with an agenda to promote will claim that someone has “refuted” a claim when all the person has done is express a contrary view, with or without supporting evidence.

Refuting a claim or argument means showing that it’s invalid. It doesn’t require proving that the contrary position is true, but it requires thoroughly knocking the props out from under a claim. Here are some ways to refute an assertion:
(more…)


Beware of fake statistics 1

Some research I recently did for an article turned up a statistic that would have made a nice centerpiece: 60% of small businesses that experience cyberattacks go out of business within six months! If I were a hack writer, I could just have run with it; it’s “confirmed” on plenty of websites. But it smelled phony.

First, what exactly is it counting? It doesn’t even say “successful” cyberattacks. Let’s assume it means that, though. Almost every business falls victim to some malware. The consequences can be small or huge. It might contact a server that no longer exists and do nothing. It might attempt to encrypt files for ransomware but fail. It might mine for cryptocurrency, send spam, or try to enlarge a botnet. Those are all bad but won’t usually destroy the business.

Second, how much of the correlation is causation? Small businesses have high mortality rates in general. It just isn’t plausible that cyberattacks are wiping out huge numbers of small companies.
(more…)


The researcher’s guide to beating the search engines 1

If you’ve ever tried to research a difficult topic on Google, DuckDuckGo, Bing, or any of the other major search engines, you know what a battle it is. You don’t just get irrelevant results, you get the feeling the search engine is working against you. Instead of matching your keywords, it returns matches for vaguely similar spellings. Instead of matching all your search terms, it gives you popular pages that match just one. You may start to think the search engines are conspiring against you, and in a sense you’re right.

Why the search engines fight you

Here’s the secret: Search engines think you’re stupid. They think you can’t construct a proper search and they have to “help” you by guessing your real intent. Statistically, this isn’t so unreasonable. Most people have no idea how to construct a search string. They can’t spell. Search engines have dumbed themselves down to the level of these people. This is great if you can’t remember the spelling of a name and you’re looking for popular articles, but it’s murder when you’re trying to get an answer to a difficult query.
(more…)