Community

Blog Events Webinars Tutorials Forum
  1. Blog
  2. Events
  3. Webinars
  4. Tutorials
  5. Forum
Create Account
×
Community Blog Solution 2: Build Your Llama2 LLM Solution with Compute Nest (ECS + AnalyticDB for PostgreSQL)

Solution 2: Build Your Llama2 LLM Solution with Compute Nest (ECS + AnalyticDB for PostgreSQL)

Explore the integration of AnalyticDB for PostgreSQL with large language models on Alibaba Cloud's Compute Nest, empowering businesses with efficiency.

By Haoran

Explore the integration of AnalyticDB for PostgreSQL with large language models on Alibaba Cloud's Compute Nest, empowering businesses with efficiency.

Step 1. Create Your VPC and VSwitch

1.  Choose the servers llama2 adbpg

1

2.  Select region and choose instance type ecs.gn5-c4g1.xlarge which is P100 GPU with 4 vCPU.

2

Input the password.

Notes: the password cannot contains @, otherwise you will fail to launch the portal. You can use other character, eg. ! Or % etc.

3

3.  Specify the VPC and VSwitch, if this is your first time to use, you need to create the VPC to the specific region.

4

Zone should be exactly same with the region you will provision. Eg. ZoneA

5

When you go back to the compute nest page, you can refresh to configure the VPC and Vswitch, then you can confirm the order.

If you choose P100 in Indonesia, it is $3.424/hour

6

If you choose T4 in Singapore, it is $2.894/hour

7

Step 2. Launch the Hello World

1.  Click Service Instances, and find out your instance.

8

2.  Click Endpoint, and click the endpoint

9

3.  After click Browse files, you can upload the pdf.

10

4.  You can ask the question to test the result.

11

Step 3. Re-development Your Code

Reference:

Tutorials AnalyticDB for PostgreSQL Compute Nest Large Language Model LLama2 LangChain ADB PG
0 1 0
Share on

Read previous post:

Tutorial: Building an Exciting Journey for Your GenAI Application with Llama 2, AnalyticDB, PAI-EAS

Read next post:

Solution 1: Build Your Llama2 LLM Solution with PAI-EAS and AnalyticDB for PostgreSQL

Farruh

29 posts | 16 followers

You may also like

Comments

Farruh

29 posts | 16 followers

Related Products

More Posts by Farruh

See All