Salesforce Models API
The Salesforce Models API empowers developers by offering direct access to large language models in a highly flexible and customisable manner. It complements Salesforce’s suite of tools by allowing users to design workflows that fully align with their specific business goals, unrestricted by default functionality.
A key highlight here is the ability to leverage Salesforce’s “Bring Your Own Model” capability, which allows you to seamlessly integrate custom-trained models to be accessed via the API.
One great feature is the API’s ability to generate embeddings, these powerful vector representations can be stored in your Org. A good use case for this functionality would be reducing the overhead of LLM queries by implementing spacial comparisons such as dot product comparisons directly in your Org.
This would enable faster, more efficient matching in situations such as semantic search, recommendations, and personalised user interactions!