Saturday, 6 August 2022

Testing Google Lens

When I opened up my browser as usual this morning I had a small surprise when Google gave me as the first tab an outline of new functions, one of which (the tope one) was Google Lens, an AI-powered search tool that gives mixed results. To test the functionality I dropped some images into a new browser window, I’ll add four different searches here to show how it works.

Search 1: Photo of art supplies


The above photo is the cache of materials my art group co-founder dropped off as supplies for artists in Sydney if they want to come and pick them up. Simon and I have to catalogue the items so that a list can be put on the group’s blog. Here’s what Lens thought:


This is quite nice because Lens accurately identifies that we’re talking about stationery or something like that. It’s correctly generated a range of images showing things that you’d buy from Officeworks in a jumble.

Search 2: Painting of a South African landscape


I bought this little oil via Facebook Marketplace though actually it cost me nothing, the handyman in charge of part of a deceased estate just wanted to get rid of things. Here's what Lens wanted:


You can see that it "gets" that we're talking about paintings, and it has accurately brought out pictures showing landscapes. Pretty good result, though the South African angle isn't covered.
 
Search 3: ABC news segment on Uluru Statement


I took this photo of the tele the other day when news of the government response to the Uluru Statement from the Heart was to be announced. The prime minister was at the Garma Festival for the event, and after the journalists were on-camera Albanese fronted the gathering and made an address to the nation. It was an historic occasion and the number of journalists in volved in the ABC’s coverage attested to this. Here’s what Lens did with the image:


Complete fail, Lens thinking we’re dealing with men’s fashion, specifically ties. There’s a sweat shirt picture in the results as well, so clothing seems to have been the main focus of the AI.

Search 4: paramontage ‘On madness (William Cowper)’


This is one of my artworks and I was curious as to how Lens would cope with the fractured, multi-image nature of this file. Here’s what it found:


Well, it got the fact that we’re dealing with real estate alright, but that’s about as far as it was able to go without failing. Interesting attempt, however …

Search 5: painting of wildflowers in a glass jar


I bought this painting in 2008 and it's on the wall in my middle bedroom. It shows a range of things, a still-life view of the world. Here's what Lens found:


All of the resulting images show paintings of yellow flowers in a glass jar, so pretty high marks for the AI. The artist who made my work, Melissa Selby Brown, is however not acknowledged. Also, the phone and pencil sharpener are missing from the results.

No comments: