×
Community Blog Solution 2: Build Your Llama2 LLM Solution with Compute Nest (ECS + AnalyticDB for PostgreSQL)

Solution 2: Build Your Llama2 LLM Solution with Compute Nest (ECS + AnalyticDB for PostgreSQL)

Explore the integration of AnalyticDB for PostgreSQL with large language models on Alibaba Cloud's Compute Nest, empowering businesses with efficiency.

By Haoran

Explore the integration of AnalyticDB for PostgreSQL with large language models on Alibaba Cloud's Compute Nest, empowering businesses with efficiency.

Step 1. Create Your VPC and VSwitch

1.  Choose the servers llama2 adbpg

1

2.  Select region and choose instance type ecs.gn5-c4g1.xlarge which is P100 GPU with 4 vCPU.

2

Input the password.

Notes: the password cannot contains @, otherwise you will fail to launch the portal. You can use other character, eg. ! Or % etc.

3

3.  Specify the VPC and VSwitch, if this is your first time to use, you need to create the VPC to the specific region.

4

Zone should be exactly same with the region you will provision. Eg. ZoneA

5

When you go back to the compute nest page, you can refresh to configure the VPC and Vswitch, then you can confirm the order.

If you choose P100 in Indonesia, it is $3.424/hour

6

If you choose T4 in Singapore, it is $2.894/hour

7

Step 2. Launch the Hello World

1.  Click Service Instances, and find out your instance.

8

2.  Click Endpoint, and click the endpoint

9

3.  After click Browse files, you can upload the pdf.

10

4.  You can ask the question to test the result.

11

Step 3. Re-development Your Code

Reference:

0 1 0
Share on

Farruh

29 posts | 18 followers

You may also like

Comments