Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Search improvement blog #617

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Add Search improvement blog #617

wants to merge 7 commits into from

Conversation

FloorD
Copy link
Contributor

@FloorD FloorD commented Aug 26, 2024

Adds search blog for review.

  • header image requested
  • @DarrenBaldwin07 do you have any suggestion for embedding gifs? (GitHub is "complaining" about big files)

Copy link
Contributor

@DarrenBaldwin07 DarrenBaldwin07 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The build is failing because of the gif too. Looking into fixing it right now

Copy link

This pull request is automatically being deployed by Amplify Hosting (learn more).

Access this pull request here: https://pr-617.d2nhjf1y5jley2.amplifyapp.com

Copy link
Contributor

@sjmiller609 sjmiller609 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

First, I reviewed for grammar review and small suggestion, then took a higher-level look at it.

In my opinion, there is greater opportunity in this blog to make a case for why using Tembo's feature for search makes sense, and emphasize that this is a simple and effective way to do search in comparison to the status quo of UI search. We should help people understand why using pg_vector and LLMs for search is the new and cool way to do it, making the content more sharable within engineering teams that may be looking to implement search. I also think that can make this blog more discoverable to those searching online for how to build a search bar using Postgres and pg_vector, which may be something people are interested in.

So overall, I think the audience is more interested in "why do it this way" and "how to do it this way" than what this feature does and the fact that there is a search bar on Tembo. i.e. we are trying to sell the vector and AI features of tembo as compelling options for users rather than trying to sell tembo cloud by saying now we have a search bar.

@samay-sharma
Copy link
Contributor

I almost completely agree with everything @sjmiller609 has said. Let's focus on the underlying Postgres based tech. The blog should be structured more to emphasize on: "Improved search in Tembo powered by Postgres and AI" (See: https://tembo.io/blog/tembo-data-warehouse for a template)

My proposed structure would be something like:

Intro to the functionality we've added

Some cool / example searches you can do and Ask functionality

Building search and ask on postgres

Explain why we feel building this on Postgres is a good idea. Avoiding Tool sprawl etc.

Powered by Postgres, pgvector and Tembo AI

Explain how we thanks to Tembo AI, pgvector and Postgres building all these apps is super straightforward. Explain the architecture and maybe an API demo

Upcoming features

Let's also say we'll have a follow up blog on how you can just add search and ask functionality to any docs you have powered by Postgres

FloorD and others added 2 commits September 18, 2024 12:39
…ex.mdx

Co-authored-by: Steven Miller <sjmiller609@gmail.com>

Our Search is underpinned by the search and command widget tool [cmdk](https://github.com/pacocoursey/cmdk), fuzzy-search library [fuse.js](https://www.fusejs.io/), and vector search. We use vector search for the Docs, dogfooding our [pgvectorize extension](https://pgt.dev/extensions/vectorize), embeddings and [pgvector](https://pgt.dev/extensions/pgvector).
We’ve also introduced an AI agent for more complex queries. _Ask Tembo_ uses 2 custom [Tembo Apps](https://tembo.io/docs/product/cloud/apps/overview), deployed and hosted on Tembo Cloud. It uses a LLM hosted on Tembo. If you do a search in the Cloud UI, you're logged in and we understand your context, your results are bound to be most relevant.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Now that we changed from product update to "here's what we did and how you can do it too" I'm going to need a lot more meat here about which apps used and how someone can replay the same script for their application @aishwaryaborkar @ChuckHend

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can write that blog but I think we should sync up about timing for it and not push that content into this PR. There's a lot to it and we will likely need to cut a lot of content to fit into a single blog. Or maybe a better idea would be to make it a series of blogs on 'building chat applications on Postgres'.

@samay-sharma, @FloorD, what are your thoughts on pushing out this as a 'product update blog' and then working on something bigger to cover the 'here's how you can do it too'?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we'd do that, will we push search for the blog as well at the same time?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cause then it'd just be:

Improved search experience for Tembo Cloud

When you’re in Tembo’s Cloud UI you might need to look up a thing you’re trying to accomplish. Rather than always having our Docs open in a second window, you can now use our improved search functionality to search our Docs, blog and website straight from cloud.tembo.io.

With our improved search capabilities you can also search within your Instances (in your currently selected Organisation - if you have multiple Organisations, you must first navigate to the appropriate Organisation).

To top it off we’ve introduced an AI agent for your more complex queries.

Search within Tembo Cloud looks like so:
GIF

You can use Cmd+K or Ctrl+K to open the search window as well.

Toggle Ask Tembo to ask our AI assistant a question:
GIF

Tembo-powered search for your application

“In the olden days” we used Algolia for Docs search, but unsatisfied with the results we wanted to try and roll our own. We will share our setup as an open source Postgres-powered alternative for search in an upcoming blog post.

What’s next?

In terms of further improvement we want to offer suggestions for queries (FAQs), and show users their recent search queries. We’re also thinking of introducing a feedback mechanism if the selection doesn't match what you were looking for.

We could also make an attempt at showing relevant results for Ask Tembo immediately while processing the query in the backend, and then show more relevant results once the query is completed.

As always, we love to hear from you about functionality that will make your life easier. Please suggest and upvote features via [roadmap.tembo.io/](https://roadmap.tembo.io/roadmap)!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants