top of page

Creating An Application

In Cyberwisdom TalentBot LLMops,an "application" refers to a real-world scenario application built on large language models such as GPT. By creating an application, you can apply intelligent AI technology to specific needs. It encompasses both the engineering paradigms for developing AI applications and the specific deliverables.

In short, an application delivers to enterprise AI developers:

  • A user-friendly, encapsulated LLM API that can be called directly by backend or frontend applications with token authentication

  • A ready-to-use, beautiful, and hosted Web App that you can develop further using the Web App templates

  • ​A set of easy-to-use interfaces for Prompt Engineering, context management, log analysis, and annotation

You can choose one or all of them to support your AI application development.

Application Types

Cyberwisdom TalentBot LLMops offers two types of applications: text generation and conversational. More application paradigms may appear in the future (we should keep up-to-date), and the ultimate goal of Cyberwisdom TalentBot LLMops is to cover more than 80% of typical LLM application scenarios. The differences between text generation and conversational applications are shown in the table below:

$L[73(}0106}0J4__KSBHEY.png

Steps to Create an Application

After logging in as an administrator in Cyberwisdom TalentBot LLMops, go to the main navigation application page Click "Create New Application" Choose a conversational or text generation application and give it a name (modifiable later)

image_edited.jpg

Create a new App

We provide some templates in the application creation interface, and you can click to create from a template in the popup when creating an application. These templates will provide inspiration and reference for the application you want to develop.

Creating from a Configuration File

If you have obtained a template from the community or someone else, you can click to create from an application configuration file. Uploading the file will load most of the settings from the other party's application (but not the datasets at present).

Your Application

If you are using it for the first time, you will be prompted to enter your OpenAI API key. A properly functioning LLM key is a prerequisite for using Cyberwisdom TalentBot LLMops. If you don't have one yet, please apply for one.

image_edited_edited.jpg

Enter your OpenAI API Key

After creating an application or selecting an existing one, you will arrive at an application overview page showing the application's profile. You can directly access your WebApp or check the API status here, as well as enable or disable them.

​

Statistics show the usage, active user count, and LLM call consumption of the application over a period of time—enabling you to continually improve the cost-effectiveness of application operations. We will gradually provide more useful visualization capabilities; please let us know what you want.

  1. Total Messages: Daily AI interactions count; prompt engineering/debugging excluded.

  2. Active Users: Unique users engaging in Q&A with AI; prompt engineering/debugging excluded.

  3. Avg. Session Interactions: Continuous user-AI communication count; for conversation-based apps.

  4. User Satisfaction Rate: Likes per 1,000 messages; indicates satisfaction with AI answers.

  5. Avg. Response Time: Time (ms) for AI to process/respond; for text-based apps.

  6. Token Usage: Daily language model token usage; for cost control.

What's Next

  • Try your WebApp

  • Take a tour of the Configuration, Development, and Logs pages on the left

  • Try configuring an application using a reference case

  • If you have the ability to develop frontend applications, please consult the API documentation

bottom of page