Now, the big model can be used as a private tour guide to plan your Citywalk route for you.
HKU MIT and other units jointly launched ITINERA, which combines LLM and spatial optimization to achieve personalized open-domain urban itinerary planning.
For example, the user typed in "Plan for me a citywalk route that includes 'Huge Wealth' and ends at Jing'an Temple".
The ITINERA system immediately generates a route with several locations and provides the corresponding introductory text.
Even the personalized needs of "bars suitable for couples to go to", "two-dimensional holy places", and "online celebrity check-in points on the way" can be understood and met by ITINERA.
It may not feel like it when you look at it alone, but let's directly compare the routes generated by ITINERA (left) and GPT-4 CoT.
The same prompt: "I want a literary route, to cross bridges and ferries." ”
It can be seen that the itinerary generated by ITINERA will pass several bridges along the Suzhou Creek and the Huangpu River ferry, and end at the Duoyun Bookstore of Literature and Art, and the route is more reasonable, concentrating the location in two spatial clusters.
However, the POI (personal preference point of interest) selected by GPT in the figure on the right does not match the bridge and ferry required by the user, and there are also detours and POI distances that are too far. In addition to this example, GPT sometimes hallucinosizes, generating POIs that don't exist.
In a nutshell, ITINERA has the following features:
- Dynamic information: Real-time updates of POIs and current popular activities
- Personalization: Prioritize personal preferences over popular attractions
- Diverse constraints: Flexibly respond to complex and diverse user needs
- Spatial intelligence: Combined with spatial optimization algorithms, the route is reasonable and efficient
ITINERA conducted training evaluations on a dataset of travel itineraries in four cities (1233 popular city routes, 7578 POIs).
The results show that it can produce better results than traditional trip planning, direct use of LLMs, etc.
目前相关论文已被KDD Urban Computing Workshop (UrbComp) 2024收录。
五大模块组成ITINERA
The next question is: How?
As shown in the figure below, ITINERA consists of five modules driven by a large model.
首先， User-owned POI Database Construction（UPC）模块从社交平台上的旅游内容中收集、构建用户兴趣点数据库。
In order to plan a trip that meets the user's request, the Request Decomposition (RD) module interprets and organizes the user's preferences and converts them into a structured data form.
Preference-aware POI Retrieval（PPR）模块将会根据用户偏好进行检索，获取最相关的若干个兴趣点。
To ensure that the itinerary is spatially coherent, the authors employ the Cluster-aware Spatial Optimization (CSO) module to spatially filter and arrange the retrieved points of interest by solving the hierarchical traveling salesman problem.
Finally, the Itinerary Generation (IG) module combines a set of candidate points of interest with multiple constraints to generate a travel itinerary and related descriptions that are spatially reasonable and meet the user's request using a large model.
Now that the principle is clear, how does ITINERA actually perform?
To find out this question, the authors collected a dataset of travel itineraries from four cities, including user requests, corresponding city itineraries, and detailed point-of-interest (POI) data.
Through objective indicators such as the recall rate (RR) of POI, the difference between the total distance and the theoretical shortest path (AM), the number of intersections in the route (OL), and the proportion of unknown POIs (FR), the accuracy of personalized recommendation POIs, the matching degree with user requests, and the spatial rationality of the generated route were evaluated.
Even in order to solve the problem that the attractiveness of points of interest and the matching degree of user requests cannot be quantified, the authors also use LLM to automatically evaluate the quality of POI, the quality of routes, and the matching degree of trips and user requests.
It can be seen that compared to other methods such as GPT-3.5, GPT-4, and GPT-4 CoT, the ITINERA system performs better on all indicators.
在用户和专家评估的POI质量（POI Quality）、行程质量（Itinerary Quality）和匹配度（Match）方面，ITINERA系统也获得了更高的评分。
In general, ITINERA can directly generate personalized and spatially coherent citywalk itineraries from natural language requests, which not only explores the problem of open-domain itinerary planning in the era of large models, but also provides ideas for using large models to solve complex space-related problems in urban applications.
For more details of the method and experimental results, please read the original article.
— END —
QubitAI · 头条号签约
Follow us and be the first to know about cutting-edge technology trends