On September 21, Alimama held an intelligent marketing session themed "AI makes marketing easier" at The Computing Conference 2018.
With new retail starting to boom over the past year, e-commerce marketing has come to a stage of consumer operation. In this context, Alimama launched TMOP, a new marketing optimization platform. This year, the TMOP added the technical content of brand advertising and disclosed developments of the proprietary XSHALE algorithm. Alimama continues to play a leading role in Ad Tech, as it has also launched XDL, a distributed deep learning framework developed to boost AI application in super-large-scale industrial data analysis.
With deep involvement in AI, Alimama is becoming a big technology brand and a significant icon for Ad Tech–powered marketing.
The transformation from traffic operation to consumer operation has obviously become a new trend advocated and led by the Taobao ecosystem. Alimama already had its presence in the marketing field a long time ago. TMOP is just a result of the company's explorations based on its search business.
Qiu Guang (nickname: Jiu Wu), Senior Algorithm Expert at Alimama, said that TMOP covers multiple features such as keyword recommendation, group recommendation, offer, and creativity, adding that the platform targets customers' marketing links and offers corresponding solutions and algorithm support.
For example, in the link of offer, TMOP has added a feature that links merchants' marketing needs with consumer operation. Suppose a merchant offers RMB 1 for the keyword "potato chips". TMOP will match the current online shoppers who have searched for the keyword with their probability of purchasing. If the probabilities are low, the system will reduce the offer to help the merchant spend its money on shoppers with a high probability of purchasing. The team led by Qiu also published a paper about this sequential decision–oriented real-time bidding strategy, which was included in KDD, a premier conference on data mining.
Consumer-centered operation means that every consumer is unique, breaking the model of single product operation. Therefore, TMOP features a distinctive search ranking algorithm, where different consumers see different titles, images, and other information for the same product. The system can dynamically match new titles for consumers in real time according to their characteristics. The dynamic title feature alone has contributed a 2% increase of click rate on average.
Qiu said his team has particularly strengthened the feature of automation in the TMOP design, which greatly simplifies customers' operations and makes advertising more accurate, intelligent, and inclusive.
Based on intelligent algorithms, Alimama integrates and extracts data from search results, recommendations, videos, finance, logistics, and Alibaba-related websites and apps, and gets a large, complex, and heterogeneous uni data picture. This valuable picture contains billions of nodes and tens of billions of edges, and depicts relationships among merchants, products/advertisements, and users from multiple perspectives.
Lin Wei (nickname: Yang Kun), Senior Algorithm Expert at Alimama, further explained how Alimama maps the entities in the uni data picture to high-dimensional space through the proprietary algorithm for deep learning on graphs to match the user intent with relevant advertisements.
For example, LasGNN, the second generation of algorithm for semi-supervised deep learning on graphs, depicts both annotated information and graph structure information through heterogeneous graph convolution. Annotated information provides core indicators such as clicks and transactions for LasGNN, while graph structure information provides a large amount of consistency knowledge of the same data ecosystem to help LasGNN better understand the relationships between user intent and products/advertising materials. Lin particularly mentioned two points:
Alimama has also built an industrial graph training engine, which supports storage and training of billions of nodes and tens of billions of edges and realizes algorithms for multi-graph migration and graph convolution. The engine helps the algorithm for deep learning on graphs understand the user intent and products/advertising materials more comprehensively, accurately, and efficiently.
There is a big difference between performance advertising and brand advertising. According to Zhu Wenxiang (nickname: Heng Yun), Senior Algorithm Expert at Alimama, e-commerce related performance advertising stresses on real-time bidding. On the other hand, brand advertising focuses on a contractual guarantee, which means that an advertiser buys traffic for a future period, and the platform guarantees the traffic for the time, quantity, and price of the advertisements stipulated in the contract.
Alimama's brand advertising helps brands identify, operate, and manage consumers by redefining the relationship between consumers and brands.
With a core algorithm for accurate guarantee, Alimama's brand advertising features the following three technological innovations:
Most fine-grained advertising allocation
Today, brands also value advertising effect. The advertising supply node was detailed from groups into users so that the advertising effect can be directly optimized according to users' preferences for particular brands.
Complex and constrained operator abstraction
In the brand advertising business on platforms such as Taobao and Youku, there are numerous specific needs, such as priority of advertisers, mutual exclusion of resources, and complex frequency control requirements. We abstract them to operators as constraints for the optimization problem.
Large-scale problem optimization solution
Through the distributed parameter server architecture, we optimized the large-scale bipartite graph allocation. Through a gradient descent and iterative solution, we achieved a balance between accuracy and speed. By arranging task priorities, we formed a directed acyclic graph for parallel processing of multiple tasks. In the process of advertising, we can make real-time adjustments according to the completion of guaranteed traffic.
Zhu's team has also used Alimama's XSHALE algorithm to achieve a minute-level optimal calculation on advertising probabilities for hundreds of advertising plans on the advertising supply nodes corresponding to over 100 million users.
Hailed as an algorithm genius, Gai Kun (nickname: Jing Shi), Senior Director of Alimama's accurate demonstration technology department, said that as the next-generation industrial distributed deep learning framework independently developed by Alimama, XDL is vital to not only the current marketing, but also Alimama's development in the coming years.
Deep learning has boosted the development of Internet algorithms in recent years. The core driver for deep learning technology is a strong training framework. Whoever has a bigger architecture and stronger algorithm ability will get a head start in the future competition. The world's Internet behemoths such as Google and Facebook have raced to develop and open-source their deep learning frameworks. However, the existing open source frameworks are based on applications such as images and voices, which are inefficient for processing typical high-dimensional, sparse, and discrete data in fields of advertising, search, and recommendation.
Alimama's XDL is a next-generation distributed deep learning framework developed based on Alibaba's massive business scenarios. XDL features four original key paradigms (data paradigm, new model paradigm, new capability paradigm, and new architecture paradigm), making it a genuine industrial deep learning framework. Achieving a nearly linear speed-up ratio for 1,000-node concurrency, XDL has the ability to train hundreds of billions of sparse parameters, online stream-oriented training, and full-process asynchronous pipelines to maximize the hardware saturation rate.
Currently, XDL has been widely applied in a variety of Alimama's business scenarios, creating a cumulative revenue of over RMB 10 billion. Thanks to its new architecture, XDL offers highly efficient training for a series of original model algorithms, including an arbitrary deep learning and full-database retrieval model based on a tree structure, and a super-large-scale end-to-end heterogeneous network with a user behavior image and CTR model. It is encouraging that Alimama is expected to open-source XDL in the future to empower the entire industry.
As it digs deeper into fields from the top-layer intelligent marketing algorithm to the underlying deep learning platform, Alimama is making marketing easier through its AI-led Ad Tech, and it is getting closer to being the world's most efficient integrated digital marketing cloud platform.
To learn more about digital marketing on Alibaba Cloud, visit www.alibabacloud.com/solutions/digital-marketing
Hosting ASP.NET Web Data App with Microsoft SQL Server on Alibaba Cloud
2,605 posts | 747 followers
FollowAlibaba Cloud MaxCompute - September 12, 2018
Alibaba Clouder - June 10, 2020
Alibaba Clouder - September 6, 2018
5793564117225178 - October 12, 2022
Alibaba Clouder - March 30, 2020
Andrew Dunn - November 11, 2022
2,605 posts | 747 followers
Follow
Platform For AI
A platform that provides enterprise-level data modeling services based on machine learning algorithms to quickly meet your needs for data-driven operations.
Learn MoreLearn More
MaxCompute
Conduct large-scale data warehousing with MaxCompute
Learn MoreMore Posts by Alibaba Clouder
