One close example shared online showed how this technology is being misused. In the viral post, a customer ordered eggs from Instamart and found only one egg cracked but with one prompt of āapply more cracksā, to Gemini Nano, he turned that images into several eggs being cracked turning the image to show more than twenty cracked eggs to look completely real. The team accepted the photo at face value and processed a full refund almost instantly.
The episode has sparked fresh concerns about how easily AI-generated images can exploit trust-based refund systems. With misuse becoming simpler, experts warn that quick-delivery platforms could face significant losses if such tactics grow. The bigger challenge now is upgrading verification processes fast enough to keep pace with advancing AI tools.
Instamart Falls For AI-Edited Photo, Approves Refund A post on X (formerly Twitter) shared an image with a striking claim: āSomeone ordered eggs on Instamart and only one arrived cracked. Instead of filing a simple complaint, they fired up Gemini Nano and typed: āAdd more cracks.ā Within seconds, the AI transformed the tray into what looked like 20 plus broken eggs so realistic it was impossible to tell the difference. Support glanced at the āevidenceā, approved a full refund, and moved on.ā The user went on to warn that refund systems were designed for a time when photos could be trusted.
Read Full Article on Zambian Observer
[paywall]
Now, theyāre up against 2025-grade AI and āgetting wiped out.ā If even a small fraction of users exploit this gap, they argued, the economics of quick commerce could collapse. āAI isnāt the enemy here,ā the post added. āThe real issue is verification systems stuck in an outdated world.
This is AI vs AI now.ā Netizens ReactionsReacting to the post one user wrote, āEvery AI should have a permanent watermarkā. āAnd that is how the refund policy will be stopped. Seriously, no business will now believe the customer even though it is genuineā, another wrote.
Another wrote, āThis kind of mindset is whatās hindering exponential progress. Instead of using his talent in doing something positive, heās using it to make some small money while ruining the life of the delivery guy. And Iām sure heās quite proud of his āachievementā without a single shred of remorseā. Talking about society and people in general, another wrote ājust a low trust society , trying to scam a company bcz they feel they are entitled to refundsā.
[/paywall]