[FE] Add Vector Text Splitting Options to the UI

[ryanweiler92]

Description

We recently added another text splitting method for file uploads on Vector Databases. There now exists three options, 'Tokens', 'Recursive' and 'Semantic'. We should expose these options in the UI when uploading a document to a vector database. We need to make sure that 'Tokens' is always the default selection.

[GSrini92]

Hi @ppatel9703 @ryanweiler92 I have added the options in the UI when uploading a document to a vector database.

Implemented in couple of places,

1. Creation of new vector database, added the options as additional fields in the Advanced Settings sections. PFB the screenshots for the reference,

2. After creation of database, on embedding a new file, added the options in File Upload Modal,

I am utilizing the existing CreateEmbeddingsFromDocuments API with extra param (splitOptions) to pass the value of the selected option.

Kindly confirm whether the above approach is the expectation or not.

,

[ppatel9703]

@ryanweiler92 Can we confirm that this should be going to advance settings?

[ehynd]

@Gunasrini18 could you please link the pr to this ticket?

[Gunasrini18]

Hi @ehynd The PR has been linked to this ticket. Kindly verify.
#1106