“I no longer look at somebody’s CV to determine if we will interview them or not,” declares Teri Morse, who oversees the recruitment of 30,000 people each year at Xerox Services. Instead, her team analyses personal data to determine the fate of job candidates.
She is not alone. “Big data” and complex algorithms are increasingly taking decisions out of the hands of individual interviewers – a trend that has far-reaching consequences for job seekers and recruiters alike.
What is big data?
It’s a bit of a misnomer: “Ex-Guardian writer Simon Rogers once said, ‘Big data is data that is one bit too much for you to be comfortable’, and this is probably the best definition I’ve read.
“The volume of data is not irrelevant, but not as important as it sounds. More important is the ability to link diverse datasets with each other.”
– Giuseppe Sollazzo, senior systems analyst at St George’s, University of London, and member of the open data user group
It’s about time we dropped the “big” jargon: “It’s just data. Data volume and velocity is exponentially increasing, but has always been too big to easily store and process … One thing that has changed in the last few years is the recognition from decision makers – not just analysts – that data is a valuable resource.”
– Tom Smith, director of the Oxford Consultants for Social Inclusion
Why is it important for government?
“Joining up public sector data sources can make government more efficient, save money, identify fraud and help public bodies better serve their citizens.”
– Claire Vyvyan, executive director and general manager of public sector at Dell UK
“Data can enable government to do existing things more cheaply, do existing things better and do new things we don’t currently do.”
– Tom Heath, head of research at the Open Data Institute
The importance of algorithms in our lives today cannot be overstated. They are used virtually everywhere, from financial institutions to dating sites. But some algorithms shape and control our world more than others — and these ten are the most significant.
Just a quick refresher before we get started. Though there’s no formal definition, computer scientists describe algorithms as a set of rules that define a sequence of operations. They’re a series of instructions that tell a computer how it’s supposed to solve a problem or achieve a certain goal. A good way to think of algorithms is by visualizing a flowchart.
Every reservation is analyzed by Airbnb’s algorithm, which combs it for red flags — new listings that are signing up reservations at a suspicious clip; messages that include the term Western Union — and assigns it a trust score. If the trust score is too low, someone from Airbnb’s trust and safety team will follow up to ensure that everything is on the level. And of course, these efforts are supplemented by Airbnb’s user reviews and comments, which can also steer unsuspecting renters away from dicey properties.
All this seems to work well enough for Airbnb. But as the sharing economy spreads across so many other markets — from car rides to house cleaning — other companies could benefit from this storehouse of data as well. After all, if someone wanted to sign up as a Lyft driver, it would be good to know that they had been banned from Airbnb. That prospect has led some to predict the dawn of a fully reputation-based economy — one in which your behavior and track record follows you from service to service, a kind of FICO score for the sharing economy that would let both platforms and individuals know how trustworthy you are based on your history and activity.
HELSINKI, Finland — If there’s something you’d like to know about Helsinki, someone in the city administration most likely has the answer. For more than a century, this city has funded its own statistics bureaus to keep data on the population, businesses, building permits, and most other things you can think of. Today, that information is stored and freely available on the internet by an appropriately named agency, City of Helsinki Urban Facts.
There’s a potential problem, though. Helsinki may be Finland’s capital and largest city, with 620,000 people. But it’s only one of more than a dozen municipalities in a metropolitan area of almost 1.5 million. So in terms of urban data, if you’re only looking at Helsinki, you’re missing out on more than half of the picture.
Helsinki and three of its neighboring cities are now banding together to solve that problem. Through an entity called Helsinki Region Infoshare, they are bringing together their data so that a fuller picture of the metro area can come into view.
That’s not all. At the same time these datasets are going regional, they’re also going “open.” Helsinki Region Infoshare publishes all of its data in formats that make it easy for software developers, researchers, journalists and others to analyze, combine or turn into web-based or mobile applications that citizens may find useful.