Skip to content

[FE] Add Vector Text Splitting Options to the UI #954

@ryanweiler92

Description

@ryanweiler92

Description

We recently added another text splitting method for file uploads on Vector Databases. There now exists three options, 'Tokens', 'Recursive' and 'Semantic'. We should expose these options in the UI when uploading a document to a vector database. We need to make sure that 'Tokens' is always the default selection.

Activity

changed the title [-][DRAFT] Add Vector Text Splitting Method to the UI[/-] [+][DRAFT] Add Vector Text Splitting Options to the UI[/+] on Apr 22, 2025
changed the title [-][DRAFT] Add Vector Text Splitting Options to the UI[/-] [+][FE] Add Vector Text Splitting Options to the UI[/+] on May 9, 2025
GSrini92

GSrini92 commented on May 12, 2025

@GSrini92

Hi @ppatel9703 @ryanweiler92 I have added the options in the UI when uploading a document to a vector database.

Implemented in couple of places,

  1. Creation of new vector database, added the options as additional fields in the Advanced Settings sections. PFB the screenshots for the reference,

Image

Image

  1. After creation of database, on embedding a new file, added the options in File Upload Modal,

Image

I am utilizing the existing CreateEmbeddingsFromDocuments API with extra param (splitOptions) to pass the value of the selected option.

Kindly confirm whether the above approach is the expectation or not.

Image,

ppatel9703

ppatel9703 commented on May 12, 2025

@ppatel9703

@ryanweiler92 Can we confirm that this should be going to advance settings?

ehynd

ehynd commented on May 22, 2025

@ehynd

@Gunasrini18 could you please link the pr to this ticket?

Gunasrini18

Gunasrini18 commented on May 23, 2025

@Gunasrini18
Contributor

Hi @ehynd The PR has been linked to this ticket. Kindly verify.
#1106

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

    Development

    Participants

    @ryanweiler92@GSrini92@ppatel9703@ehynd@Gunasrini18

    Issue actions

      [FE] Add Vector Text Splitting Options to the UI · Issue #954 · SEMOSS/semoss-ui