Everyone’s experimenting with ChatGPT, even crypto exchanges.
Coinbase recently turned to artificial intelligence to experiment with how accurately ChatGPT could carry out a token security review—a requirement for all tokens listed on the exchange.
After reviewing 20 different smart contracts, the mega-popular AI tool produced the same results as the manual review 12 times.
However, of the eight misses, five were cases where ChatGPT incorrectly labeled a high-risk asset as low-risk, which is the worst-case failure.
The experiment also revealed that the AI sometimes produced inconsistent results, with the same prompt generating different outcomes, especially when moving from one iteration of ChatGPT to the next.
Still, the Coinbase team is optimistic that—with further prompt engineering—they can increase the accuracy of ChatGPT to a point where it could be used as a secondary quality assurance check.
"We are not surprised because such smart contracts can also be automatically audited by [other traditional programming] tools," a spokesperson from BlockSec, a blockchain security infrastructure firm, told Decrypt. "However, it cannot work for complicated business logic, which are the main attack surfaces and the main loopholes that smart contract audits should focus on.
Coinbase’s optimism about using the tool for additional assurances was nonetheless echoed by other security experts in the crypto-security space.
"At this stage, it [AI] can not replace a person, but it is an indispensable aid, including for tired or inattentive auditors," independent security researcher Officer's Notes told Decrypt via Twitter. "I think that Q/A [quality assurance] and fuzzing will definitely not be able to do without AI tools in the future."
ChatGPT replacing engineers
Though tentative, the blockchain security sector seems to be accepting of the possible implementation of AI tools.
But could AI replace manual security auditors in the future?
"Perhaps one day we’ll get to that point, but we’re still a long way off. What’s more likely is a complementary approach. There are some things humans do better than machines and vice versa," Certik’s head of solutions architecture Connie Lam told Decrypt via email, "Tools help us build new things, but they don’t replace us. The invention of the calculator didn’t make accountants obsolete, it made them better at their job."
For now, though, non-AI security tools are still far more useful than anything just entering the market to locate vulnerabilities.
"Current security audit tools are still superior to OpenAI," a spokesperson from OpenZeppelin told Decrypt. "They [Coinbase] are testing it for listing ERC-20 tokens, which is a well-known pattern. That makes it more suitable for automation."
That may change though.
The rapid advances seen even between ChatGPT 3.5 and ChatGPT 4 are palpable, suggesting that further upgrades will continue to impress.
And as they do, integrating these tools should even be “encouraged.”
"The use of ChatGPT should be encouraged during the development phase. It’s a powerful tool, and refusing to work with it and learn what it can do would be a setback," said Lam. "ChatGPT is also a very powerful tool for searching for information and building a knowledge hub. It can help users quickly grasp complicated topics and keep up to date on the latest security information.”
Crypto user Michael lost the wallet password for 43.6 bitcoins stored in 2013, then worth only $5,300, now nearly $3 million. With the help of hardware hacker Joe Grand and his friend Bruno, they discovered an exploitable vulnerability and successfully cracked the password.
WeiliangIggy Azalea joins a growing list of celebrities linked to alleged serial scammer Sahil Arora, as a project bearing her name nets $300,000 in its presale.
KikyoAptos blockchain experienced a massive surge in transaction volume, driven primarily by the "tap-to-earn" game Tapos Cat, which generated over 115 million transactions in a day. While this showcased Aptos' scalability, questions arise about its sustainability and the need to expand beyond clicker games to foster genuine utility and long-term growth.
AnaisSpot Ether ETFs could potentially launch by late June, especially after BlackRock updated its Form S-1 filings. In contrast, Hashdex has withdrawn its application. Given the green light, why is Ether’s price not soaring?
CatherineThe President of the New York Stock Exchange reveals that if the regulatory landscape becomes clearer, the exchange will consider directly offering cryptocurrency spot trading.
AlexBlackRock has submitted the S-1 document for an Ethereum spot ETF. Analysts predict that this ETF could begin trading before the end of June.
MiyukiThe Federal Reserve released its Beige Book report yesterday, indicating that overall economic activity in the United States is growing but indirectly forcing people to change their spending habits. The Beige Book gives a pessimistic summary of the overall economic activity in the U.S.
WeiliangThe alleged individual, who launched Caitlyn Jenner’s Solana token, also took over $300K presale funds of an Iggy Azalea coin. Azalea has stated she is not involved and has instead launched her own token. So who is Sahil Arora, the man behind the recent series of celebrity meme coin launches?
KikyoBuffett has long opposed Bitcoin, but his company Berkshire Hathaway still profits from cryptocurrencies.
AlexBrock Pierce, a founding veteran of Tether, the issuer of USDT, has released a significant signal, suggesting that China will eventually open its cryptocurrency market. He is preparing to return to work in Hong Kong for the third time.
Alex