Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
hachyderm.io is one of the many independent Mastodon servers you can use to participate in the fediverse.
Hachyderm is a safe space, LGBTQIA+ and BLM, primarily comprised of tech industry professionals world wide. Note that many non-user account types have restrictions - please see our About page.

Administered by:

Server stats:

9.7K
active users

hachyderm.io: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.5

Public
Simon Willison

It seems to be a capable vision model - I got this result running gemma3:27b via Ollama on my Mac

llm -m gemma3:27b describe -a https://static.simonwillison.net/static/2025/two-pelicans.jpg Here’s the full response: Overall Impression: The image features two brown pelicans in flight against a solid, bright blue background. The composition is dynamic, capturing the birds mid-wingbeat. Details: Pelicans: Both pelicans are a rich, dark brown color. They have large, pale yellow-orange beaks and pouches. One pelican is shown with its wings fully extended, appearing to be gliding or soaring. The other is captured with its wings in a more dynamic, upward-sweeping motion. Background: The background is a flat, uniform shade of bright blue, which makes the pelicans stand out. Composition: The birds are positioned in opposite directions, creating a sense of movement and balance. The image is well-lit, highlighting the texture of the pelicans’ feathers. Overall, the image is a striking and visually appealing depiction of these majestic birds in flight.
A photo of two pelicans in flight
Joaquin :OhNoBubble:

@simon have you had any luck invoking function calls? It seems like the chat template doesn't include any special tokens for tool inputs and outputs

Mar 13, 2025, 11:29 AM·Public
0boosts·0favorites
Public
Simon Willison

@redscroll structured data extraction with schemas via Llama seemed to work well, I've not tried the function calling style of tools yet

Public
Joaquin :OhNoBubble:

@simon by structured data extraction are you referring to constrained decoding like using grammars? Or just asking it to respond in a specified json schema via the prompt?

Public
Simon Willison

@redscroll Ollama has grammar support baked in that works against any model, I'm using that

ExploreLive feeds
About