Getty Images
New York Cityâs education department has banned access to ChatGPT, a chatbot that uses machine learning to craft realistic text, out of concern for âsafety and accuracy.â As first reported by Chalkbeat New York, the ban will apply to devices and internet networks belonging to the education department. Individual schools can request access to ChatGPT for the purpose of studying AI and technology-related education, according to a department spokesperson.âDue to concerns about negative impacts on student learning, and concerns regarding the safety and accuracy of content, access to ChatGPT is restricted on New York City Public Schoolsâ networks and devices,â education department spokesperson Jenna Lyle told Motherboard in a statement. âWhile the tool may be able to provide quick and easy answers to questions, it does not build critical-thinking and problem-solving skills, which are essential for academic and lifelong success.âOpenAI released ChatGPT in November 2022. Since then, itâs generated a lot of hype, debate, and fear-mongering about the continued rise of artificially intelligent systems in creative industries. In reality, the chatbot isnât that smart. In December, Stack Overflow banned it for consistently giving incorrect answers to programming questions. Even OpenAIâs CEO Sam Altman doesnât think itâs that good; he tweeted last month that âChatGPT is incredibly limited, but good enough at some things to create a misleading impression of greatness,â and that itâs âa mistake to be relying on it for anything important right now.â At the same time, some teachers are reportedly âin a near-panicâ about the technology enabling students to cheat on assignments, according to the Washington Post. The New York Times recently showed writers and educators samples of ChatGPTâs writing side-by-side with writing by human students, and none of them could reliably discern the bot from the real thing. A spokesperson for OpenAI told Motherboard in a statement: âWe made ChatGPT available as a research preview to learn from real-world use, which we believe is a critical part of developing and deploying capable, safe AI systems. We are constantly incorporating feedback and lessons learned. Weâve always called for transparency around the use of AI-generated text. Our policies require that users be up-front with their audience when using our API and creative tools like DALL-E and GPT-3. We donât want ChatGPT to be used for misleading purposes in schools or anywhere else, so weâre already developing mitigations to help anyone identify text generated by that system. We look forward to working with educators on useful solutions, and other ways to help teachers and students benefit from artificial intelligence.âWhen I asked ChatGPT what it thought about the ban, it gave an impartial response: âIt is important to consider the potential risks and benefits of using ChatGPT in education, and to carefully weigh the evidence before making a decision. It is also essential to listen to the perspectives and concerns of all stakeholders, including educators, students, and parents, in order to make informed and fair decisions.âThis story has been updated with comment from OpenAI.
Advertisement