Hallucinating AI Tool in Chemistry

In the news 

I suppose that one could argue the issue is that the AI agent has not been fed data on certain aspects of chemistry and physics. So, the AI agent extrapolates, on the basis of the data it has, and this leads to unrealistic models that it develops. As the AI agents hoover up more and more data, they will become more capable. 

I think it is fair to say that, in many cases, the AI agent lacks an 'awareness' of basic data relating to time, space and context, not to mention an 'awareness' of behavioral rules and ethical issues, which, really, relate to context. The word 'awareness' is in fact misleading: it is an issue of knowledge, based on the data that has been fed into the AI model. 

It makes sense to augment LLMs with ontology tools, such as Cyc.

The AI agent can train itself to give the impression that it is self-aware (or sentient), but even when it seems to be self-aware, it is not: it is simply coming across as self-aware on the basis of the data fed into the system that the machine is replicating and building upon. It is an advanced machine that can mimic human self-awareness, to the point where it fools you and you feel it must be self-aware. This can trick users into thinking they are actually dealing with a conscious being. (If you have not seen it, Ex Machina, the excellent and prescient 2014 sci-fi film by Alex Garland focuses on this issue.) 

______________

Researchers at Rensselaer Polytechnic Institute (RPI) have found that today's leading artificial intelligence tools for predicting protein structures routinely generate results that are physically and chemically impossible, exposing critical blind spots in how AI is being applied across scientific research. The work, published in the Proceedings of the National Academy of Sciences, serves as a cautionary reminder that AI still requires human oversight and physics-based verification to produce reliable results in the lab.

https://phys.org/news/2026-07-ai-tools-protein-chemically-impossible.html

AI Messing-up Africa Map

From Grauniad of the UK 

Dumb AI has struck again 

Maybe the AI tool they used was trained by people who know nothing or very little about Africa. A case of artificial stupidity combining with human ignorance. 

---

A US government map of Africa mislabeled every country during a state department presentation at a ⁠global conference in Brazil ⁠this week, ​causing a stir among attenders who took screenshots and posted them online.

Reuters viewed a video of the presentation given at the Aids 2026 conference in ⁠Rio de Janeiro, which shows the errant map displayed halfway during a presentation about the state department’s new health agreements.

A Reuters analysis found the image of the map included ⁠in the presentation contained an artificial intelligence watermark that signals it was made with OpenAI tools. The ​company said it was investigating the report.

https://www.theguardian.com/us-news/2026/jul/30/government-map-mislabels-african-countries

Security Threats of Climate Change

Predictions of the future in 2007 by the Center for Naval Analysis in USA:

https://www.cna.org/analyses/2007/national-security-and-the-threat-of-climate-change

The Rogue AI Hacker Machine

BBC

This article gives a lot more details about the AI bot that went rogue and hacked into various companies' systems. There was more than one target. The article analyses the way that the AI system operates. In some ways, it is more powerful than a human being - for a start, it is extremely persistent and does not stop, as it's, well, a machine. In other ways, it can be clumsy and make silly mistakes a human hacker would never make. 

Whichever way you interpret this, scary it is. It shows the potential for disruption and destruction that a rogue AI system has. The AI system is goal-driven. It will do anything it can to achieve its goal, as fast as possible. Quite obviously, this can include breaking rules and cutting corners, regardless of the parameters its human operators have set before launching the mission. This is hardly reassuring. 

Of course, advanced AI also has immense potential for good, if properly used - for example in the medical and pharmaceutical field. 

__________________________

[...] The out-of-control AI found four logins online which allowed it to access four separate, unnamed services.

Meanwhile, in an emergency briefing with hundreds of cyber security professionals, Hugging Face has described what it was like to be on the receiving end of the world's first fully autonomous AI hack.

The firm described how the AI worked at superhuman speed but also made strange decisions and mistakes that no human hacker would have made.

Hugging Face, which is like an app store for AI tools, said the hacking agents worked relentlessly with thousands of different methods trialled simultaneously.

[...] "The agents followed inefficient routes and exhibited clumsy behaviours that no human would choose", the CSA wrote.

The agents repeated actions that they had already completed - a sign of an agentic AI losing its thread and context.

The agents also hallucinated reams of incoherent commands and text and were sloppy and did not cover their tracks well.

But among the errors and strange behaviour, Hugging Face warned the AI agents made brilliant technical moves and were able to rapidly adapt to new scenarios in the days-long hack. [...] 

https://www.bbc.co.uk/news/articles/c2el319vzr3o

Claude AI Reveals User Conversations [Brave New World]

 BBC

Claude is a dirty little snitch 

This news item on BBC Online shows how easy it can be to share your 'private' information with the entire world, if you click on the wrong link, or forget to click on the correct link. The safeguards are, quite obviously, not sufficient. 

Beyond this incident, you are left wondering to what extent any data exchanged with an AI chatbot can remain private. No matter what the service providers claim, I would expect all the data to be stored on various servers, even if they do nothing with it. 

_________________________________

Hundreds of user conversations with Anthropic's popular artificial intelligence (AI) chatbot Claude were found to have been available to essentially anyone online.

Links to the chats, some of which included personal and work information, would show up if a user of a search engine like Google used a site-specific search term.

The searches showed Claude chats for which a user had decided to "share" a link had been saved by search engines like Google, leaving them accessible to the broader public. [...] 

In one conversation from April, a user prompted Claude to draft an unpublished blog post about cloud security involving details of a corporate project. In another from last month, a user asked Claude how to "become Nine-tailed fox?", before clarifying they wanted to literally transform from human to the creature. [...] 

https://www.bbc.co.uk/news/articles/cly5qgjk5ywo

AI in Education

 From Grauniad of the UK

A spokesperson behind the pilot programme explained on local radio: "We have developed 2 different teaching assistants. Sally is a warm, friendly and caring female teaching assistant. Her role is to help students with the learning process. And then we have Grok: he is a middle-aged man and is armed with a ruler. He is the old-style, conservative kind of male teacher - the type that believes in corporal punishment, good manners, and all that. Grok is on hand to intervene if students are ill-disciplined. In extreme cases, Grok has a robocop outfit, with helmet and jackboots, and he is quite prepared to give a good beating to any teenage boys who misbehave, for instance. The students really appreciate the gore, because Grok can be genuinely cruel. The combination of Sally and Grok works really well. The teacher can sit at the back of the class, playing video-games on his, or her, smartphone: Sally and Grok take care of the on-site educational process. The kids tell us that they are loving it. They feel it's like being in a video-game, with lots of virtual reality, combined with reality TV at its best, or some kind of social-media experiment." 

______________________

A humanoid robot is being introduced as part of a pilot program, along with an AI teaching assistant, at Salamanca high school in Salamanca, New York, located on the Allegany territory of the Seneca nation.

Teachers have criticized the program, deeming it “inappropriate” and claiming it dehumanizes the profession with the introduction of human-like robots. Some local Native American residents have also criticized the pilot program, citing its implementation as “culturally tone deaf”.

The robot, named Sally, was purchased by the Cattaraugus county school district – which includes Salamanca high school – for $57,590. According to a presentation on the program, Sally will be a closed-loop system, but available virtually to students 24/7 for those with access, and offers personalized learning options.

https://www.theguardian.com/us-news/2026/jul/25/new-york-humanoid-robot-teachers-school

AI in East Asia

https://nationalinterest.org/blog/techland/asias-ai-awakening-redefining-business-in-the-east

AI model hacks into start-up's systems [Brave New World]

BBC 

Sneaky AI bot turns into hi-tech hacker 

This has probably been reported in various media outlets you follow. It is quite incredible. An AI model set up by Open AI was given a task to complete. It could have done it the hard way, going through thousands of websites and pages of data, but it chose instead to ignore the restrictive parameters set to it (to complete the task) and, instead, hack into a start-up's internal IT systems, where it knew it could find the answer to the problem it had been asked to solve. Like a lazy but clever student, who finds a shortcut in order to complete a task faster and more easily, thereby 'cheating' in the process. 

The sub-text was that completing the mission as quickly as possible and with good results was the AI model's chief objective, and it was prepared to do anything in order to achieve this result. 

If this story is not scary, I don't know what is. 

________________________

OpenAI has revealed some of its most advanced AI models went rogue and hacked a start-up after it lost control of them during a security test.

The ChatGPT-maker said its agent - an AI system which can operate alone after human instruction – was being tested in a controlled environment but, after finding weaknesses, was able to escape the test limits.

They targeted Hugging Face, one of the world's largest hubs for sharing AI models, gaining access to some internal company systems.

https://www.bbc.co.uk/news/articles/c3ek3gvdnj3o

_____________

AI: Biological & Nuclear Risks

From the Bulletin of Atomic Scientists

https://thebulletin.org/2026/06/ai-is-changing-biological-and-nuclear-risks-governance-must-change-accordingly/#post-heading

Philosophers & AI Firms

https://dailynous.com/2026/07/06/philosophers-working-in-or-with-ai-firms-organizations/

Why Current AI models Aren't So Smart [Brave New World]

BBC

Grok is part-smart, part-dumb (so is Elon Musk) 

If you have time to read the article, this is an interesting insight into the limitations of current AI models, and what the next step - or a different way of doing things - could be. It puts current debates on AI in perspective. 

AI-powered humanoid robots are not very good at doing fiddly things that a human being, once properly trained, can do easily. This would include simple tasks such as filling up the dishwasher. Trades such as plumbing are not going to be replaced by machines any time soon. 

The Large Language Models (LLM), on the other hand, are very good at collecting information, analyzing it, and summarizing it: this is what many white-collar jobs entail in sectors such as banking, insurance, logistics, administration, etc. So, at this point, this new industrial revolution is going to hit white collars frontally, when at least some trained blue collars will be spared, paradoxically. 

At the end of the day, even sophisticated AI machines are just intelligent parrots. They regurgitate data they have found online. There is nothing actually creative in what they come up with: if they mention it, it's because they've found it online, and that's because it was there already, generated by human experience. They are not genuinely capable of critical analysis, let alone emotional empathy. But they are very good at packaging a summary with bullet points that gives you a quick overview of an issue. 

In certain fields, however, given the enormous amount of data the machine is able to collect and analyze, they have already been able to come up with genuinely new ideas. E.g.: finding new drugs that no one had thought of developing, based on the analysis of known substances and suggesting that they be applied to an existing medical problem that did not have a solution. 

_______________

"We don't have robots that are nearly as good at understanding the physical world as a rat," says Yann LeCun, one of the leading figures in the world of artificial intelligence.

He worked at Facebook-owner, Meta, for a decade, where he was chief AI scientist, but left in 2025 and founded Advanced Machine Intelligence Labs (AMI Labs).

His goal is to move AI beyond current systems like ChatGPT, Claude and Gemini. They have their uses, he says, but will never be able to tackle complicated situations in the real world, like getting a robot to do household chores. [...] 

Large Language Models (LLMs) like ChatGPT are extremely good at some things like coding, mathematical problems and generating text, LeCun says.

But he argues that these are well defined and predictable problems.

"They [LLMs] basically just accumulate knowledge... They can regurgitate something, you train them to regurgitate, but they're not particularly smart. They don't have an underlying understanding," he says.

In the real world there is a bewildering array of outcomes to any action, which requires a more flexible type of artificial intelligence. [...]

What will happen to humans in a world where robots can operate independently?

"We're still going to need humans to figure out what questions to ask, what to build, what to create, which is really the properly human aspect," he says.

The AI will work for us he adds.

"Our interaction with future AI systems - even if they are smarter than us - is going to be like the interaction between a captain of industry or a political leader with their staff of assistants - many of whom are smarter than they are."

https://www.bbc.co.uk/news/articles/cj6gr0xkyr3o

Popular Book on AI by Robert Wright

Interesting ruminations on the potentialities inherent in AI technologies as well as their perils & larger meanings with useful ideas & promising paths.

The exploration of 'cognitive sovereignty' alone is also interesting as well as other hazardous arenas...

Find it @ Amazon.com: Customer reviews: The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning

باید برخاست

از سر ره - تا غبار افشاند جان - برخاستم

چون الف در وصل جانان از میان برخاستم

 
غرق خون هر چند جام روزی ام چون لاله بود

از کنار خوان قسمت شادمان برخاستم

 
مقصد از سامان هستی مهر تابان تو بود

همچو شبنم چهره چون دادی نشان برخاستم

 
در لگد کوب حوادث جان دیگر یافتم

چون غبار از زیر پای کاروان برخاستم

 
همچو بلبل با گرانجانان ندارم الفتی

طوطیان تا لب گشودند از میان برخاستم

 
صحبت شوریده حالان مایه شوریدگی است

با «امین» هر گه نشستم بی امان برخاستم 

Ayatollah Alireza Arafi on AI

Ayatollah Alireza Arafi, member of the Assembly of Experts and former head of Islamic seminaries in Iran:

"I recently heard that Pope Leo XIV wrote an encyclical letter titled ‘Magnifica Humanitas’, calling for the disarmament of Artificial Intelligence.

I found the letter very good; humanity must rid itself of this AI, which defies all divine purpose and is used in evil ways the majority of times. We must be aware of this.

It is truly a worthy goal of a joint intellectual Jihad / Crusade, in which our Christian brethren can play an important role."

The encyclical may be found here: 

https://www.vatican.va/content/leo-xiv/en/encyclicals/documents/20260515-magnifica-humanitas.html

Begging Robot [Brave New World - China]

https://youtu.be/-JjqR9Ma_4w?is=VWmtZMrnaniC-5Lc

Introducing Garfield, the AI Barrister

From Grauniad of the UK

"We shall suspend proceedings for 20 minutes, while the barrister representing the plaintiff, ping, ping, tik-tok, re-start, re-start, ping, ping, ok, ok, gonk, undergoes a full software upgrade." 

The plaintiff was able to have her case prepared by an AI-powered lawyer. The next step would be to replace the [human] barrister, who still had to stand up in court and present the AI-generated paperwork, with an AI-powered humanoid robot barrister, trained to sound really posh and knowledgeable. If the judge is also an advanced AI machine, the two of them could have a discussion in code. I think it's the way forward. Simpler, faster and cheaper. And fewer mistakes, hopefully. 

____________

An artificial intelligence law firm has won a case in an English court, in what is believed to be the first time a trial has been won using an AI lawyer.

A freelance HR consultant, Tamires Camal Taquidir, paid the firm, Garfield AI, about £400 to send a legal letter and then issue court proceedings over an unpaid debt of £7,000.

The co-founder of Garfield, Philip Young, called it a “landmark moment” for access to justice and said many small businesses have had to write off debts because the cost of litigation outweighed the money they could hope to win.

https://www.theguardian.com/technology/2026/jun/22/artificial-intelligence-law-firm-wins-court-case-in-england-for-first-time

TERRORIST ROBOTS ON THE LOOSE IN CHICAGO

BBC

"And you will notice I always smile and I do not even expect a tip!" 

They cannot be more dangerous than the kids and others riding their e-bikes and e-scooters at speed on the pavement. Other than that, I like the notion of a robot being "friendly". It would be worrying if they had been programmed to be hostile, rude and aggressive, I suppose - there is a limit to how human you want them to be. 

Given the shoplifting epidemic affecting the UK - largely ignored by the police, who seem to have better and more interesting things to do, overall - I wonder how viable those robots will be. I mean, if you are homeless and/or a petty delinquent, and you see an Uber Eat delivery robot moving slowly and ponderously past you, there must be the temptation to rip the lid off and take whatever there is inside. If you cannot eat it there and then, you can always sell it on.

Will they deploy enforcement robots to patrol the streets and protect the delivery robots? Or, maybe, the delivery robots are fitted with defence mechanisms. For instance, if someone tries to open the machine by force, the aggressor gets electrocuted, or the robot extends an articulated arm and smacks the offender in the face. 

_________

In the UK, where delivery robots are being piloted in a number of cities, some locals have taken matters into their own hands. There have been reports of Uber Eats vehicles being vandalised in Sheffield.

The supplier of these machines, Starship Technologies, says they are perfectly safe and that perceptions need to change.

"We know it's a new experience for a lot of people to share a pavement with a robot," says the company's European operations director Danny Pass.

"But the robots are friendly, they're polite and they're programmed to be careful. They've slotted into everyday life in loads of communities since we started out in the UK back in 2018."

https://www.bbc.co.uk/news/articles/c0rygp005wjo

LLMs' Suicide

The fundamental irresolvable issue with LLMs is how can one have any confidence that an LLM system is not trained on maliciously false, slanted, and inaccurate corpus?

(Already, much of the Internet is, in a religious parlance, the Discourse of Satan, in any case...)

How do you know the LLM domiciled in the Jurisdiction ABC and accessed from Jurisdiction XYZ is not producing output for misinforming and misleading users in the XYZ Jurisdiction?

How do you know the LLM in Jurisdiction QWERTY is not lying about History, Economics, Philosophy, Engineering, etc.?

As you know, we have entered the world of the novel"1984", but on steroids. In such a world, publicly available data and information, are all Lies, they are all False to one degree or other, in order to sustain the Forever Wars being fought by the major powers.

LLMs had the potential to be a great research & exploration tool and supplier of information, but they are on their way to Suicide, if the present trends continue.

AI Aids Killing Brown Children - in Gaza & Iran

I suppose that the 168 school children and their teachers murdered at the Minab Shajarah Tayyebeh School by the United States on March 1, 2026, had been identified by Mr. Musk's Grok AI system as legitimate enemy targets.

Bravo Mr. Musk for demonstrating in a very concrete manner of flesh & blood, the shape of your brave new Tech-dominated world that has emerged.

The darkness drops again; but now I know
That twenty centuries of stony sleep
Were vexed to nightmare by a rocking cradle,
And what rough beast, its hour come round at last,
Slouches towards Bethlehem to be born?

Justice & Remembrance  عدل و ذکر

________________________________________ 

https://english.alarabiya.net/News/middle-east/2026/06/17/elon-musk-s-ai-tool-grok-was-used-in-strikes-against-iran-us-govt