China’s evolving algorithmic surveillance system will rely on the security organs of the communist party-state to filter, collect, and analyze staggering volumes of data flowing across the internet. Justifying controls in the name of national security and social stability, China originally planned to develop what it called a “Golden Shield” surveillance system allowing easy access to local, national, and regional records on each citizen. This ambitious project has so far been mostly confined to a content-filtering Great Firewall, which prohibits foreign internet sites including Google, Facebook, and The New York Times. According to Freedom House, China’s level of internet freedom is already the worst on the planet. Now, the Communist Party of China is finally building the extensive, multilevel data-gathering system it has dreamed of for decades.
While the Chinese government has long scrutinized individual citizens for evidence of disloyalty to the regime, only now is it beginning to develop comprehensive, constantly updated, and granular records on each citizen’s political persuasions, comments, associations, and even consumer habits. The new social credit system under development will consolidate reams of records from private companies and government bureaucracies into a single “citizen score” for each Chinese citizen. In its comprehensive 2014 planning outline, the CCP explains a goal of “keep[ing] trust and constraints against breaking trust.” While the system is voluntary for now, it will be mandatory by 2020. Already, 100,000 Chinese citizens have posted on social media about high scores on a “Sesame Credit” app operated by Alibaba, in a private-sector precursor to the proposed government system. The massive e-commerce conglomerate claims its app is only tracking users’ financial and credit behavior, but promises to offer a “holistic rating of character.” It is not hard to imagine many Chinese boasting soon about their official scores. [...]
While Westerners and especially civil liberties groups like the ACLU are horrified by such a prospect—one commentator called the possibility “authoritarianism, gamified”—others argue that because lack of trust is a serious problem in China, many Chinese welcome this potential system. However, a state-run, party-inspired, data-driven monitoring system poses profound questions for the West about the role of private companies in government surveillance. Is it ethical for private companies to assist in massive surveillance and turn over their data to the government? Alibaba (China’s Amazon) and Tencent (owner of the popular messaging platform WeChat) possess sweeping data on each Chinese citizen that the government would have to mine to calculate scores. Although Chinese companies now are required to assist in government spying while U.S. companies are not, it is possible to imagine Amazon in Alibaba’s position, or Facebook in place of Tencent. While private companies like credit scoring bureaus have always used data to measure consumers’ creditworthiness, in any decent society there must be a clear distinction between private-sector and public-sector scoring mechanisms that could determine access to citizen rights and privileges, without recourse.
No comments:
Post a Comment