Resource

MaxCompute resources

The resources that you can upload to MaxCompute include text files, MaxCompute tables, Python code, and compressed packages in .zip, .tgz, .tar.gz, .tar, and .jar formats. You can read or use these resources when running UDFs or MapReduce.

E-MapReduce resources

The E-MapReduce resources that you can upload to DataWorks include JAR and file resources.

Log on to the DataWorks console. In the left-side navigation pane, click Workspaces. On the Workspaces page, find the target workspace and click Data Analytics in the Actions column.

Move the pointer over the icon, choose EMR > Resource, and then select EMR JAR or EMR File. The procedure for creating an E-MapReduce resource is the same as that for creating a JAR resource.

Create a JAR resource

1. On the DataStudio page, create a JAR resource.
   You can create a JAR resource in either of the following ways:

   • Move the pointer over the icon and choose MaxCompute > Resource > JAR.
   • Find the target workflow, click MaxCompute, right-click Resource, and choose Create > JAR.
2. In the Create Resource dialog box that appears, enter the resource name and select the target folder. Then, click Upload and select the target file to upload.
   Note

   • If the selected JAR package has been uploaded from the MaxCompute client, clear Upload to MaxCompute. If you do not clear it, an error will occur during the upload process.
   • The resource name can be different from the name of the uploaded file.
   • A resource name can contain letters, digits, underscores (_), and periods (.), and is case-insensitive. It must be 1 to 128 characters in length. A JAR resource name must end with .jar, and a Python resource name must end with .py.
3. Click OK to create the JAR resource.
4. Click the icon in the toolbar to commit the resource to the development environment.
5. Deploy the node.

   For more information, see Deploy a node.

Create a Python resource and register a UDF

1. Create a Python resource.
   1. On the DataStudio page, move the pointer over the icon and choose MaxCompute > Resource > Python.

      You can also find the target workflow, right-click MaxCompute, and choose Create > Resource > Python.

   2. In the Create Resource dialog box that appears, enter the resource name and select the target folder. Then, click Upload and select the target file to upload.
   3. Click OK.
   4. On the page that appears, edit the code of the created resource. Sample code:

      from odps.udf import annotate
      @annotate("string->bigint")
      class ipint(object):
          def evaluate(self, ip):
              try:
                  return reduce(lambda x, y: (x << 8) + y, map(int, ip.split('.')))
              except:
                  return 0

   5. Click the icon in the toolbar to commit the Python resource.
2. Register a UDF.
   1. On the DataStudio page, move the pointer over the icon and choose MaxCompute > Function.

      You can also find the target workflow, right-click MaxCompute, and choose Create > Function.

   2. In the Create Function dialog box that appears, enter the function name and select the target folder.
   3. Click Commit.
   4. On the Register Function page that appears, enter the class name and the name of the Python resource that has been created, and then click the icon in the toolbar. In this example, the class name is ipint.ipint.
   5. Check whether the ipint function is valid and meets your expectation. For example, you can create an ODPS SQL node to test the ipint function by running an SQL statement, as shown in the following figure.

odps@ MaxCompute_DOC>add py D:/ipint.py;
OK: Resource 'ipint.py' have been created.                

odps@ MaxCompute_DOC>create function ipint as ipint.ipint using ipint.py;
Success: Function 'ipint' have been created.           

After the resource file is uploaded, register a UDF on the MaxCompute client. For more information, see Functions operations.

You can use the UDF after it is registered.

Reference and download resources

• For more information about how to reference resources for functions, see Function.
• For more information about how to reference resources for nodes, see ODPS MR node.

To download a resource, double-click Resource under the target workflow. In the resource list that appears, move the pointer over the required resource and click Download.