A Science Magazine OpEd.
AI in scientific publishing: Slower, worse, and more expensive
H. HOLDEN THORP, Ed., Science Magazine
There’s a saying in the management world, popularized by NASA administrator Daniel Goldin in the 1990s, that the goal of technological improvements is to make products faster, better, and cheaper. Although this strategy had some success in the aerospace industry, the zealots of artificial intelligence (AI) have been making the same argument regarding how it will transform work, claiming that so little human effort will be required that humanity will enter an era of radical abundance, free from disease, drudgery, and danger, among other benefits, leaving society with more time for creative pursuits. But history tells a different story. When machines began to increase productivity during the second industrial revolution, American engineer Frederick Winslow Taylor’s The Principles of Scientific Management encouraged corporations to use surveillance to get employees to work harder and longer, an approach that exhausted and discouraged workers and led to the transfer of knowledge and any decision-making from workers to management, while enriching the profits for only those at the top. Yet, it remains foundational to the American economic enterprise. Indeed, scientific publishing is starting to experience some Taylorism with the insertion of AI. Rigorous human checking of AI-generated research papers is creating bottlenecks as publishers strive to maintain the integrity of the scientific record. The challenge is requiring even more human effort, making the whole endeavor slower and more expensive...These factors are complicating scientific publishing. The rate of research submissions at Science and other journals is increasing because conducting research and producing papers are accelerating. But because more papers contain more AI-generated errors, greater human oversight is required to check the findings...The creation of robust human-curated scientific literature has never been more crucial. The propagation of AI slop in the scientific record and generally on the internet is making science less trustworthy...The history of Taylorism indicates that society should fight to protect the welfare and agency of those being pushed to do too much by technology in the name of production.
If the scientific community fails to address the influence of AI, then authentic research and validated findings will slow down to an expensive trickle into established knowledge, and the opportunities for flawed or fabricated information to be seen as reality will grow—all while AI profiteers cash in.
TAYLORISM, UGH
INTRODUCTIONPresident Roosevelt in his address to the Governors at the White House, prophetically remarked that “The conservation of our national resources is only preliminary to the larger question of national efficiency.”The whole country at once recognized the importance of conserving our material resources and a large movement has been started which will be effective in accomplishing this object. As yet, however, we have but vaguely appreciated the importance of “the larger question of increasing our national efficiency.”We can see our forests vanishing, our water-powers going to waste, our soil being carried by floods into the sea; and the end of our coal and our iron is in sight. But our larger wastes of human effort, which go on every day through such of our acts as are blundering, ill-directed, or inefficient, and which Mr. Roosevelt refers to as a lack of “national efficiency,” are less visible, less tangible, and are but vaguely appreciated.We can see and feel the waste of material things. Awkward, inefficient, or ill-directed movements of men, however, leave nothing visible or tangible behind them. Their appreciation calls for an act of memory, an effort of the imagination. And for this reason, even though our daily loss from this source is greater than from our waste of material things, the one has stirred us deeply, while the other has moved us but little.As yet there has been no public agitation for “greater national efficiency,” no meetings have been called to consider how this is to be brought about. And still there are signs that the need for greater efficiency is widely felt.The search for better, for more competent men, from the presidents of our great companies down to our household servants, was never more vigorous than it is now. And more than ever before is the demand for competent men in excess of the supply.What we are all looking for, however, is the readymade, competent man; the man whom someone else has trained. It is only when we fully realize that our duty, as well as our opportunity, lies in systematically cooperating to train and to make this competent man, instead of in hunting for a man whom someone else has trained, that we shall be on the road to national efficiency.In the past the prevailing idea has been well expressed in the saying that “Captains of industry are born, not made”; and the theory has been that if one could get the right man, methods could be safely left to him. In the future it will be appreciated that our leaders must be trained right as well as born right, and that no great man can (with the old system of personal management) hope to compete with a number of ordinary men who have been properly organized so as efficiently to cooperate.In the past the man has been first; in the future the system must be first. This in no sense, however, implies that great men are not needed. On the contrary, the first object of any good system must be that of developing first-class men; and under systematic management the best man rises to the top more certainly and more rapidly than ever before.This paper has been written:First. To point out, through a series of simple illustrations, the great loss which the whole country is suffering through inefficiency in almost all of our daily acts.Second. To try to convince the reader that the remedy for this inefficiency lies in systematic management, rather than in searching for some unusual or extraordinary man.Third. To prove that the best management is a true science, resting upon clearly defined laws, rules, and principles, as a foundation. And further to show that the fundamental principles of scientific management are applicable to all kinds of human activities, from our simplest individual acts to the work of our great corporations, which call for the most elaborate cooperation. And, briefly, through a series of illustrations, to convince the reader that whenever these principles are correctly applied, results must follow which are truly astounding.This paper was originally prepared for presentation to the American Society of Mechanical Engineers. The illustrations chosen are such as, it is believed, will especially appeal to engineers and to managers of industrial and manufacturing establishments, and also quite as much to all of the men who are working in these establishments. It is hoped, however, that it will be clear to other readers that the same principles can be applied with equal force to all social activities: to the management of our homes; the management of our farms; the management of the business of our tradesmen, large and small; of our churches, our philanthropic institutions our universities, and our governmental departments.
Frederick Winslow Taylor. The Principles of Scientific Management (pp. 5-7). (Function). Kindle Edition.
I came to the "quality control & management" movement in 1986 when I took up 5 & 1/2 yrs of contract employment with a forensic-level environmental radiation laboratory in Oak Ridge.
I joined ASQ—back then "ASQC," the "American Society for Qualty Control." I served the Lab as a technical apps programmer and Statistical Process Control analyst (SPC).
Back then, "Taylorism" was a cautionary tale of the outdated (mostly white male) paternalistic past. The Main Dudes were Shewhart and Deming.
Shewhart was esteemed history. Deming was methodologically "Biblical" in the era. We were all in. I soaked it all in. In 1992 I passed the intimidating ASQ Exam for Certified Quality Engineer. The 4-hour open book test from Hell with a fail rate of 50%. I headed to the nearest bar after finishing.
My subsequent Cert was 'Total Quality Management / Continuous Quality Improvement" issued in the wake of 6 moths' training at IHC in Salt Lake City.
Eventually, all things went "Lean."
I became a member of ASQ's "Lean Division." Touted "Lean" books here on the blog.
When I began posting this blog, I made ample note of my affinity for progressive QC/QA/QI methods. By 2016 I was covering various "Lean Heathcare" events. On the heels of that stuff came our mixed-metaphor "Agile" schtick. (My dubiety reeks a bit.)
I eventually became the ASQ Las Vegas Section 705 Chairman, and then went on to co-found and lead the Nevada Quality Alliance (NvQA), a state-level Baldrige-modeled nonprofit assessment and award program.
QI has by now turned out to be a mixed blessing. Specifically under the likes of Jeff Bezos et al, much of it has become faux-quantifed (e.g., "6-Sigma") gussied-up Taylorism. I am pleased to see AAAS voicing their/our concerns. Unsure at this point as to what will prove to be effective remediation.
"The creation of robust human-curated scientific literature has never been more crucial. The propagation of AI slop in the scientific record and generally on the internet is making science less trustworthy."
apropos: "Is there a 'science' of science communication?"
CODA
[NY Times] A Florida pastor sued OpenAI on Wednesday, claiming that its chatbot, ChatGPT, had offered him “extremely dangerous medical recommendations” that led to delayed care for a life-threatening pulmonary embolism last year.
The lawsuit claims that ChatGPT had assured Scott Winters that the early warning signs of his health crisis were “not something dangerous,” and had dissuaded him from seeking medical advice, instead telling him to trust that “God did not design your body to endlessly fail.”
The suit, filed in the Superior Court of California in San Francisco, accuses OpenAI and its chief executive, Sam Altman, of negligence and the “unauthorized practice of medicine,” pointing to moments when the chatbot offered Mr. Winters diagnoses and treatment plans and encouraged him to ignore pleas from friends and family to seek medical care…
Practicing Medicine without a license or SME.
