## Advanced Models and Practice for Addressing Emerging Cross-Cutting Issues in Multimodal Transportation Research

View this Special IssueResearch Article | Open Access

Haigen Min, Yukun Fang, Runmin Wang, Xiaochi Li, Zhigang Xu, Xiangmo Zhao, "A Novel On-Ramp Merging Strategy for Connected and Automated Vehicles Based on Game Theory", *Journal of Advanced Transportation*, vol. 2020, Article ID 2529856, 11 pages, 2020. https://doi.org/10.1155/2020/2529856

# A Novel On-Ramp Merging Strategy for Connected and Automated Vehicles Based on Game Theory

**Academic Editor:**Eneko Osaba

#### Abstract

Connected and automated vehicles (CAVs) have attracted much attention of researchers because of its potential to improve both transportation network efficiency and safety through control algorithms and reduce fuel consumption. However, vehicle merging at intersection is one of the main factors that lead to congestion and extra fuel consumption. In this paper, we focused on the scenario of on-ramp merging of CAVs, proposed a centralized approach based on game theory to control the process of on-ramp merging for all agents without any collisions, and optimized the overall fuel consumption and total travel time. For the framework of the game, benefit, loss, and rules are three basic components, and in our model, benefit is the priority of passing the merging point, represented via the merging sequence (MS), loss is the cost of fuel consumption and the total travel time, and the game rules are designed in accordance with traffic density, fairness, and wholeness. Each rule has a different degree of importance, and to get the optimal weight of each rule, we formulate the problem as a double-objective optimization problem and obtain the results by searching the feasible Pareto solutions. As to the assignment of merging sequence, we evaluate each competitor from three aspects by giving scores and multiplying the corresponding weight and the agent with the higher score gets comparatively smaller MS, i.e., the priority of passing the intersection. The simulations and comparisons are conducted to demonstrate the effectiveness of the proposed method. Moreover, the proposed method improved the fuel economy and saved the travel time.

#### 1. Introduction

Congestion has caused many problems such as excessive fuel consumption and increased travel time in the real transportation system. According to a survey, the total cost of congestion in urban areas in the United States was estimated at 160 billion dollars and an extra 3.1 billion gallons of fuel consumed in 2014 [1]. Collaborative control of connected autonomous vehicles (CAVs) in a networked environment enables vehicles to cooperate with each other through information interaction, which can improve the road traffic efficiency and reduce the energy consumption while ensuring safety. To achieve the cooperative control of vehicles, advanced localization [2] and communication technologies [3, 4] (including V2V (vehicle to vehicle) and V2I (vehicle to infrastructure) communication, etc.), are required to assist the autonomous vehicle making decisions. Control of CAVs can be applied to many issues related to transportation optimization, and one of them is on-ramp merging of vehicles. In fact, on-ramp merging is one of the main causes of traffic congestion and the bottleneck of the traffic efficiency [5] since vehicles attempting to merge may initially slow down even and stop on the on-ramp to await a proper opportunity to merge. CAVs controlled by algorithms with high efficiency are expected to be able to reduce traffic congestion and enhance vehicle safety [6–9]. More key technologies and algorithms for CAVs control have been surveyed in [10].

The essence of the on-ramp merging problem is the competition for the priority of passing the merging area and reflected on the assignment of merging sequence (MS) for CAVs under the control of a centralized controller. We can regard such competition as a game in which every agent (i.e., the connected autonomous vehicle) competes for the prior merging sequence. Contribution of this paper just lies in the game framework we developed. In this paper, we propose a centralized approach based on game theory to control the on-ramp merging of all agents without any collisions and reduce the cumulative fuel consumption and total travel time. As to the game, we regard vehicles on the same road as a group and they will collaborate to compete with another group. Benefit, loss, and rules are three basic components in a game, and in our framework, benefit is the priority of passing the merging point and loss is the cost of fuel consumption and the travel time. Rules are the core for a game since agents in each group take actions based on the game rules to maximize the benefits and minimize the loss, and we proposed three basic rules in accordance with the Traffic Density Principle, FIFO (First In First Out) Principle, and Wholeness Principle, respectively. Importance of three rules varies, and we formulate the problem as a double-objective optimization problem of cumulative fuel consumption and total travel time, searching the feasible Pareto solutions to ascertain the weight of each rule.

Simulations and comparisons are conducted to validate the effectiveness of the proposed framework. Contribution of this paper mainly lies in the (1) construction of the framework for global optimal merging of CAVs based on the game theory and (2) approaches to searching the Pareto solutions and ascertaining the optimal weights of three rules via back search through formulating the problem as a double-objective optimization problem.

The structure of the paper is depicted as follows. In Section 2, we will introduce the related work. Section 3 describes the problem framework. Modeling and solution will be illustrated in Section 4, and simulation results and analysis will be displayed in Section 5. We end the manuscript with conclusions in Section 6.

#### 2. Related Work

Current researches of on-ramp merging mainly focus on the scheduling algorithm of passing vehicles per unit time and control of merging at the expressway to improve the traffic efficiency [11–15]. A series of related control algorithms, control strategies, and scheduling algorithms are proposed under security principles. For example, in 2004, Dresner and Stone [16] proposed an automatic intersection control method based on retention algorithm. Generally, research work of CAVs on-ramp merging can be divided into centralized methods and decentralized methods [17], and both of these two categories have been studied [18–21]. Ntousakis et al. [20] proposed a decentralized automatic merging algorithm, in which each vehicle makes use of the information received from other agents to ascertain the appropriate sequence to merge on the ramp, and experiments show that the algorithm is safely executed and the traffic stability is well maintained. In comparison to the decentralized methods, centralized approaches have also been widely discussed. Cao et al. [21] have proposed the concept of cooperative merging, in which only the vehicles on the main road get the information of the vehicles on ramp road from the centralized controller and then adjust their speed to optimize the passing efficiency. In [22], both centralized and decentralized methods are adopted and a trajectory planning method is proposed to optimize engine efficiency and passenger comfort by adding jerk (derivative of acceleration) in the objective function. The analytical solution is obtained using the optimal control theory and the linear quadratic regulator method, and the model predictive control scheme is then used to compensate for potential interference in the trajectory.

However, most of the methods discussed focus on the optimization of vehicle trajectories with little or no emphasis on the calculation of the best merge sequence (MS), and few studies have discussed the creation of MS assignment [23]. Besides, game theory is also seldom seen in the literature related to the research about on-ramp merging. In essence, issue of vehicles merging at intersection can be regarded as the competition for a prior MS from the angle of an individual agent, which means that small MS represents the priority of passing the merging point. In [24], Jing et al. proposed a cooperative multiplayer game-based optimization framework to coordinate vehicles and achieve minimum values for the global payoff conditions. To simplify the problem, the multiplayer games were decomposed into multiple two-player games and finally formulated as an optimization problem and got an analytic solution.

We also apply game theory to deal with the on-ramp merging issue but the differences between our work and [24] primarily lie on the following: (1) cooperation is allowed among vehicles on the same road, and the competition is between two groups; (2) more aspects, like traffic intensity, fairness, and wholeness principle, are considered when designing the game rules.

#### 3. Problem Framework

The scenario of vehicle merging consists of a main road and a ramp road and both of them are single lane. We assume there exists a centralized controller that can communicate with all vehicles in the control area without any time delay. The control area is divided into *Game Area*, where each agent adopts its optimal strategy according to the game rules, and *Adjusting Area*, where each agent adjusts their states to cooperatively pass the merging point *O* without any collisions. *O* is the origin of the coordinates, and the two roads are noted as *X*_{m} and *X*_{r}, representing the main road and ramp road, respectively, and the length of *Game Area* and *Adjusting Area* is *G* and *M*, as shown in Figure 1.

Assume that there are *W* vehicles passing the merging point during the research time and the centralized controller will assign the passing sequences *i* (*i* = 1,2, …, *W*) to each agent at the moment when the first vehicle *V*_{1} reaches the *Adjusting Area*, in accordance with the states of all vehicles at that moment. Each vehicle *V*_{i} is modeled as a point mass and its state is described aswhere represent the position (or coordinate value), velocity, and acceleration of the vehicle *V*_{i} at the time *t* and *t* = 0 is the moment when the *W* th vehicle *V*_{W} enters the *Game Area* (we assume that length of the *Game Area* is long enough and the first vehicle *V*_{1} is still in *Game Area* at *t* = 0).

#### 4. Modeling and Solution

Game theory is the cornerstone of the proposed model, and in this section, we will illustrate our model in detail and formulate the problem and then give a numeric solution based on searching Pareto solutions.

##### 4.1. Priority of Passing Game

In a game, each player tends to make the best decision for himself/herself based on the obtained information and game rules. In *Game Area*, each agent can obtain the information of other agents from the central controller and try to gain the maximum benefits with minimum cost based on a series of rules and the information obtained. Here, *t* = 0 is the time when the game begins, and the game ends at the moment when the first vehicle reaches the *Adjusting Area*. And, in this part, we will illustrate the benefits, cost, and rules in detail.

During the gaming period, vehicles on the same road take the strategy of cooperation since overtaking is not allowed on a single lane road. We regard all vehicles on the main road as a group to compete with another group consisting of all vehicles on the ramp road, and each group tends to strive for the maximum benefits with least possible cost from the holistic perspective. Benefits are the merging sequences (MS, also known as passing sequences) assigned to each vehicle, and small MS represents a senior right to pass the merging point. The cost is originated from state changing of the vehicles, represented via fuel consumption, and the rules are given empirically and listed as below: *Rule 1*: vehicles in the group that contains more vehicles are more prior to pass *Rule 2*: vehicles that are closer to the merging point *O*, i.e., have greater coordinate values, are more prior to pass *Rule 3*: vehicles with smaller mean space gap from its preceding agent and its following agent are more prior to pass

These rules can be explained via three principles, i.e., Traffic Density Principle, FIFO Principle, and Wholeness Principle, respectively.

*Rule 1* takes the Traffic Density Principle into consideration. If one of the roads has more vehicles, it means the traffic density of this road is higher and gives passing priority to the vehicles on this road which will improve the traffic efficiency (represented by the passing time of all vehicles).

*Rule 2* is in accordance with the FIFO Principle, and this rule is related to fairness. Assume there are two roads, i.e., Road A and Road B, converging at an intersection, and the traffic density of Road A is much greater than Road B. The traffic efficiency will be improved if vehicles on Road B stop before the merging area to await the vehicles on another road passing through the merging point. But such a situation is unfair to the vehicles on Road B because they suffer from a jam at the same time.

*Rule 3* is related to the Wholeness Principle. Considering the scenario shown in Figure 2, *x*_{j} (*j* = 1,2,…, 6) represents the coordinate values of vehicle *V*_{j} and *x*_{1}> *x*_{2} > *x*_{3} > *x*_{4} > *x*_{5} > *x*_{6}. Among these vehicles, *V*_{2}, *V*_{3}, and *V*_{5} are on the main road and *V*_{1}, *V*_{4}, and *V*_{6} are on the ramp road, and the spacing gap between *V*_{2} and *V*_{3} is much smaller than that between *V*_{1} and *V*_{4}. Assume *V*_{1} and *V*_{2} will have a collision when merging if none of them change their states, and in this case, adjusting *V*_{1} pays less cost than adjusting *V*_{2} and *V*_{3}. That means *V*_{2} and *V*_{3} share more “wholeness” than *V*_{1} and *V*_{4} and should have the priority to pass the merging point as a whole. Similar analysis can be done to *V*_{4}, *V*_{5}, and *V*_{6}. In fact, this rule is the extension of *Rule* 1 embodied in a specific local area and represented by measuring the mean space gap of a vehicle between its preceding one and its following one (the first vehicle on a road uses the gap between itself and its following one to describe this attribute, while the last vehicle on a road uses the gap between itself and its preceding one to describe this attribute). For example, *L*_{23} depicts such attribute to *V*_{2} and (*L*_{23} + *L*_{35})/2 to *V*_{3}.

Based on these three rules aforementioned, each vehicle will adjust their states during gaming period with two motivations, i.e.,(a)Gaining a coordinate value as greater as possible (*O* is the origin of coordinates and the positive direction is the moving direction of vehicles, as shown in Figure 1.)(b)Narrowing the space gap between successive vehicles under the safe vehicle space distance constraint

We use IDM (intelligent driver model) to depict following vehicles in a group, and the leader vehicle for each group will adopt the strategy of speeding up. Once there is a vehicle reaching the *Adjusting Area*, the game ends and we note this moment as *t*_{f}. And, the controller assigns MS to each vehicle according to the states of all vehicles at *t*_{f} moment. IDM [25] is formulated as follows:where is the velocity at moment *t*, which can be iteratively obtained from , Δ*t* is the interval of two successive time frames, is the velocity that the vehicle expects to achieve, *S* is the real distance between the vehicle and its preceding one, *S*_{0} is the minimal safety distance between two vehicles, *T*_{h} is the time headway, is the velocity difference between two successive vehicles (note: (*t*) is the velocity of the preceding vehicles at moment *t*, ), and *α* and *β* are two parameters.

Equation (2) is a linear control law to maintain the stability of a group of vehicles (also called “a platoon”), but this model may generate unstable acceleration, especially at the initialization and state switching moment. We will illustrate such cases in detail in the next part of this section.

As mentioned above, we evaluate each vehicle from 3 aspects, i.e., number of vehicles in its group, distance from the merging point *O*, and mean space distance of a vehicle between its preceding one and its following one, via scoring at the moment *t*_{f}. For each item, the vehicle which performs the best gets 10 scores and the worst one gets 1 scores, and the others linearly get the corresponding scores. For example, to get the score that evaluates the distance from the merging point (assuming the coordinate value for each vehicle *V*_{j} is , we firstly set the vehicle with the maximum coordinate value max (*x*_{j}) as 10 and the vehicle with the minimum coordinate value min (*x*_{j}) as 1 and then obtain the linear coefficient vector *K*_{2} = [*k*_{2}, *b*_{2}]^{T}:

Each vehicle *V*_{j} can be scored as

Similar technique can be applied to get the score *S*_{3} that evaluates the mean space distance of a vehicle between its preceding one and its following one:where *K*_{3} is the linear coefficient and is the mean space gap of vehicle *V*_{k} between its preceding one and its following one.

The scores are used to evaluate the number of vehicles in a group, and the vehicles in the same group will get the same score. Note *Num*_{m} as the number of vehicles on the main road and *Num*_{r} as the number of vehicles on the ramp road, and then all vehicles on the main road is scored as *Num*_{m}/(*Num*_{m} + *Num*_{r}) and *Num*_{r}/(*Num*_{m} + *Num*_{r}) for all vehicles on the ramp road.

The weight vector = [, , ]^{T} is assigned to describe the importance of *S*_{1}, *S*_{2}, and *S*_{3} correspondingly. We can get the final score *S* as

As the method of giving the optimal weight vector , we use the searching approach that will be illustrated in Section 3. And, the controller assigns the MS according to the final score. The higher score a vehicle gets, the smaller sequence (means it is more prior for the vehicle to pass the merging point *O*) the vehicle obtained.

However, it may occur that the vehicle in front is assigned a bigger MS than the vehicle behind in a group. In this case, vehicles in the same group should adjust their MS in accordance with their distance to the merging point *O* (the closer to the merging point, the smaller sequence is obtained) since overtaking is not allowed on a single lane road.

##### 4.2. State Adjusting

Once the game ends at moment *t*_{f}, the state adjusting process starts and we assume the length of *Adjusting Area* is long enough for state adjusting. We map all vehicles into one dimension, and all vehicles get a sequence based on their coordinate values, called position sequence (PS). The bigger the coordinate value of a vehicle, the smaller PS it gets. There are 3 possible relationships between MS and PS, i.e., MS = PS, MS > PS, and MS < PS. By comparing the MS and PS, each vehicle will respond differently, as shown below.

###### 4.2.1. MS = PS

MS = PS means the merging sequence for a vehicle is the same to the position sequence, and maintaining the current state will consume the least fuel. In this circumstance, the vehicle will simply obey the IDM model. but the reference vehicle may not on the same road. As shown in Figure 3, *V*_{1} and *V*_{3} are on the same road and *V*_{2} is on another road, while the relationship of their coordinate values is *x*_{1} > *x*_{2} > *x*_{3} and the MS relationship is MS_{1} < MS_{2} < MS_{3}. For *V*_{3}, its reference vehicle is *V*_{2}, not *V*_{1}.

As we mentioned in the previous part, IDM may generate acceleration jumping especially at the state switching moment. When we map all vehicles into one dimension, the reference vehicle for an agent may change, which is equivalent to that its “preceding” vehicle’s state abruptly changes and it causes the acceleration jumping. To solve this problem, we constrain acceleration within certain range to avoid the unexpected jumping.

###### 4.2.2. MS > PS

MS > PS means the merging sequence for a vehicle is more prior than its real position sequence. Therefore, it should adopt the strategy of accelerating only if the space distance of the vehicle and its preceding one is greater than the minimal safe distance.

###### 4.2.3. MS < PS

MS < PS means the vehicle should make concessions to other vehicles. Therefore, it should adopt the strategy of decelerating until it receives the signal which indicates that the PS of the vehicle is already in accordance with its MS from the controller. Then, the vehicle just simply adopts the IDM model illustrated in the part “MS = PS.”

##### 4.3. Optimization for Fuel Consumption and Travel Time

In the previous section, we discussed the possible actions that each vehicle can take in different periods (i.e., gaming period and adjusting period). We can conclude that the strategy a vehicle adopts in gaming period is in accordance with the game rules, and the weight vector = [, , ]^{T} measures the importance of different rules and its value will influence the assigning of the MS to each vehicle. Therefore, we try to find an optimal to get a reasonable MS so that the fuel consumption and total travel time can be optimized. This is a typical optimization problem of two objectives and can be formulated aswhere *F* is the total fuel consumption, *T* is the total travel time, is the function that denote the relationship between weight vector and the optimization object, *a*_{min} and *a*_{max} are the minimum deceleration and maximum acceleration, respectively, is the maximum speed limit, and *μ* and *γ* are two parameters that can adjust the object function.

As to the fuel consumption, we refer to [26, 27] and adopt the estimation aswhere *f* is the instantaneous fuel consumption consisting of and *f*_{a}, representing instantaneous fuel consumption caused by velocity and acceleration, respectively. If the acceleration value is negative, we use the absolute value instead. Coefficient vectors *q* = [*q*_{0}, *q*_{1}, *q*_{2}] and *r* = [*r*_{0}, *r*_{1}, *r*_{2}] are obtained from the experiment [28], and the values are *q* = (0.1569, 2.45 × 10^{−2}, −7.415 × 10^{−4}) and *r* = (0.07224, 9.681 × 10^{−2}, 1.075 × 10^{−3}). The total fuel consumption is the sum of instantaneous fuel consumption in each moment for all vehicles from *t* = 0 (the moment when the last vehicle arrives to the *Game Area*) to the moment when the last vehicle passes the merging point *O*, noted as *t*_{F}.

About the total travel time *T*, we start timing at *t* = 0 and end timing at *t* = *t*_{F}, and *T* = *t*_{F} − 0 = *t*_{F}.

From Formula (7), we can see that *F* and *T* are functions of , but we do not know the explicit expression of ; therefore, we cannot solve the optimization problem analytically based on (7). Besides, for a double-objective optimization problem, there usually does not exit such a solution where both objectives are optimized; we should make a trade-off between objectives according to practical requirement. Here, we will find a feasible Pareto solution [29] for this problem. A Pareto solution is the solution where further optimization for an objective is always at the cost of the deterioration of other objectives. For example, as shown in Figure 4, *A* and *B* are two objectives we dedicate to minimize and (*x*_{1}, *y*_{1}) is a Pareto solution, because if we continue decrease the value near *x*_{1} to optimize objective A, the performance of objective B will deteriorate. Situation for (*x*_{3}, *y*_{3}) is similar to (*x*_{1}, *y*_{1}), while (*x*_{2}, *y*_{2}) is not a Pareto solution since both objectives can be further minimized near this point. There are many Pareto solutions in a double (or multiple) objective optimization problem, and these solutions consist a solution set (called Pareto front), as shown in Figure 4. There are feasible solutions in such sets and we select the best fit in accordance with the trade-off between different objectives.

##### 4.4. Searching for the Pareto Solution

From previous part, we conclude that possible acceptable solutions can be found in the Pareto front set. In our problem, two optimization objectives are cumulative fuel consumption *F* and total travel time *T*, and in this part, we give the steps of searching Pareto solutions for this specific problem: Step 1: divide with comparatively large step size and compute the cumulative fuel consumption *F* and total travel time *T*.

In this step, we divide each component of with stride of 0.05, under the constraint that the sum of all components is 1. For each node, compute *F* and *T* for *N* times (*N* is the repeated computing times for a node, for example, *N* = 100) and average the results. Step 2: subdivide in the sparse area.

By analyzing the results in Step 1, the distribution of the results in some range may happen to be sparse. We further subdivide in these sparse range with stride of 0.01, even much smaller, and compute *F* and *T* for *N* times at these subdivided nodes. Step 3: find the “inflection points” on the *F*-*T* curve.

Figure 5 is a *F*-*T* curve we get in one of our simulation experiments and we call points *C* and *D* “inflection” points where optimizing one of the objectives will lead to large deterioration of another objective. In acceptable range of *F* and *T*, we regard these points as the best trade-off of different objectives according to practical requirements and choose one of them as the “best” fit for the problem. Step 4: back search for the corresponding .

We choose point as the best trade-off of our two objectives and search back to find the that correspond to (*T*_{c}, *F*_{c}). There can be several proper values for and any one of them can be chosen as the solution.

#### 5. Simulation Results and Analysis

To display the simulation results of the trajectory, velocity, acceleration, and fuel consumption during gaming and adjusting periods, we should firstly ascertain a weight vector *=* [, , ]. Based on the steps of searching Pareto solutions described in the previous section, we select = [0.15, 0.45, 0.4] as the best fit, and all case studies are under such condition. Besides, we set a “sliding window” parameter *W* to decide the number of agents per game.

##### 5.1. Case Study 1: “Sliding Window” Parameter *W* = 5

This simulation is to verify the effectiveness under the condition that the number of vehicles is comparatively small in one turn of a game, in this case, 5 CAVs driving on the two merging roads. The entry time and the number of vehicles on main road and ramp road are random. The value of the time-headway can be in the range of [1.2 s, 2.4 s] in different scenarios [30] and here we choose *T*_{h} = 1.2 s. As to the length of *Game Area* and *Adjusting Area*, we set *G* = 100 m and *M* = 200 m. Each vehicle enters the *Game Area* with a random initial speed around 15 m/s, and the maximum speed limitation is 30 m/s. And, the acceleration of the vehicles is constrained from −3 m/s^{2} to 3 m/s^{2}.

The simulation of the position, velocity, and acceleration is shown in Figures 6–8. The gaming period ends at the moment when the first vehicle reaches the *Adjusting Area*, and in this simulation, the moment is at 3.12 s. Since saltation of acceleration is not practical, we set the change rate of acceleration (also known as jerk) as 1 m/s^{3}. Therefore, there is no abrupt change of acceleration, and the profiles for velocity and trajectory are smooth except the transition moment.

The time-headway of each vehicle passing the merging point is close but not strictly equal, shown in Figure 6, since the velocity of each one at the merging point is different.

As to fuel consumption, we adopt the polynomial model given in formula (8), and it manifests that the instantaneous fuel consumption depends on the instantaneous velocity and acceleration. We try to compare the fuel consumption between our model and (1) FIFO; (2) Density Prior, and (3) No Control, as shown in Figure 9. Here, “FIFO” is the situation where vehicles that are closer to the merging point are prior to pass the merging point. “Density Prior” is the situation where vehicles on the road with higher traffic density (reflected on the number of vehicles on that road) are prior to pass the merging point and vehicles on the other road should stop to wait until all vehicles on the road with higher traffic density pass the merging point. “No Control” is the situation where vehicles on the ramp road have to stop to wait for vehicles on the main road as they cross the merging point and then start accelerating to reach the maximum speed to pass the merging point.

For FIFO, we initialize all vehicles with the velocity of 15 m/s, and the MS is assigned at *t* = 0 completely based on their distance to the merging point, and other settings are the same as our model. It is, in fact, a special situation of our model where the length of *Game Area* is zero. For “No Control,” we also set the initial velocity of each vehicle as 15 m/s, and in this situation, vehicles on the ramp road must stop to wait until vehicles on the main road passing the merging point. For “Density Prior,” we set the same initial velocity for each vehicle. Since, in this case study, the number of vehicles on the main road is greater than that on the ramp road, the vehicles on the ramp road should also stop to wait until vehicles on the main road pass the merging point. However, in Case Study 2, we discuss and display the situation where number of vehicles on the ramp road is greater than that on the main road.

From Figure 9, we can see that the proposed model consumes the least cumulative fuel at the end. However, fuel consumption of the “No Control” model is much lower at the beginning stage since vehicles do not change their states during this period. While fuel consumption of “No Control” model markedly increases in two stages, i.e., the stage in which vehicles on the ramp road slow down and stop and the stage in which vehicles on the ramp road restart and accelerate. Fuel consumption of “Density Prior” is very similar to that of “No Control,” since, in this case study, the number of vehicles on the main road is greater than that on the ramp road, and “Density Prior” and “No Control” are equivalent in this situation.

As to the comparison of the fuel consumption between proposed model and FIFO model, the difference is that there is no *Game Area* in the FIFO model. FIFO is the model that address fairness at the cost of efficiency. Therefore, we can see that the total fuel consumption of FIFO is higher than that of proposed model.

The moment when the last vehicle passing the merging point is the end of the process, and the value of this moment equals the total travel time. And, for this simulation, the total travel time is 19.60 s, shown in Figure 6. The total travel time for the FIFO model is close to the proposed model, but for the “No Control” and “Density Prior” model, it is remarkably higher (about 12% higher) than the other two.

##### 5.2. Case Study 2: “Sliding Window” Parameter *W* = 10

In this case study, 10 vehicles are involved in one turn of the game and the number of vehicles on the main road and ramp road is randomly set. Constraints for the vehicles are the same as those in Case Study 1, and some parameters are adaptively changed. We set *G* = 300 and *M* = 200, and the simulation of the position, velocity, and acceleration is shown in Figures 10–12.

From Figures 10–12, we can see that the vehicles on the main road pay more cost, reflected from the amplitude of variation of acceleration and velocity; because in this situation, the number of the vehicles on the ramp road is remarkably greater than that on the main road, and the vehicles on the ramp road are dominant as a whole based on the game rules. However, acceptable sacrifice of the disadvantaged group brings the improvement of the efficiency and stability for the whole, and we can see that the variation of the acceleration and velocity of the vehicles on the ramp road (the dominant group) is relatively smoother.

Comparison of fuel consumption among three different models in Case Study 2 is shown in Figure 13. We can see the proposed model still consumes the least cumulative fuel at the end. However, because there exist more vehicles on the ramp road in this case, fuel consumption of the “No Control” model remarkably increased especially during the stage in which vehicles on the ramp road slow down to stop and the stage in which vehicles on the ramp road accelerate. As to the “Density Prior,” vehicles on the main road slow down or stop to avoid collision in this case because number of CAVs on the ramp road is greater than that on the main road. And, we can see that the shape of the fuel consumption curve for “Density Prior” is similar to that of “No Control,” but the cumulative fuel consumption is less since fewer vehicles change their states in the “Density Prior” model than those in the “No Control” model under this case study. Analysis to the comparison between proposed model and FIFO model is similar to that of Case Study 1 and the former still takes advantages than the latter in Case Study 2.

As to total travel time in Case Study 2, it is 35.90 s, shown in Figure 10, and for the FIFO model, it is near to the proposed model. The “No Control” model spends much more time in this case study (about 17% higher than the other two) since the number of vehicles on the ramp road is much greater than that on the main road and the process of slowing down and accelerating to restart takes much time. The proposed model does not take advantage in the total travel time compared with the “Density Prior” model in this case, since the number of vehicles on different roads is unbalanced. “Density Prior” is a model that emphasizes the efficiency, and it performs well for those circumstances where the traffic density for different roads is extremely unbalanced.

##### 5.3. Brief Summary of the Simulation Results

We simulate two cases and validate the effectiveness and efficiency of the proposed model. Case Study 1 mainly focused on the scenario where the number of connected autonomous vehicles is comparatively small in one turn of a game, while Case Study 2 mainly researched the situation where much more agents are involved per round in the game. As mentioned above, FIFO is the model that addresses fairness, while “Density Prior” is a model that emphasizes the efficiency. The proposed model gives consideration to both aspects and performs well.

One thing that should be pointed out is the setting of the parameters *M* and *G*. Although we regard the vehicles as mass point, we cannot set *M* or *G* as a very small value and settings of these two parameters varies, given different “sliding window” parameter *W*.

#### 6. Conclusion

In this paper, we focus on the scenario of CAV on-ramp merging where each vehicle is equipped with V2I equipment and can communicate with the centralized controller without any time delay according to the assumption.

The core of the CAVs on-ramp merging problem lies in the assignment of the MS, and different MS leads to the difference on cumulative fuel consumption and total travel time. In our paper, we regard the competition of MS as a game and vehicles on the same road are regarded as a group taking the strategy of cooperation to strive for as small MS as possible against another group. As to the game, we proposed three basic rules in accordance with the Traffic Density Principle, FIFO Principle, and Wholeness Principle, respectively. Further, the control area is divided into *Game Area*, where vehicles on each road change their states cooperatively, attempting to get a better MS, and *Adjusting Area*, where all vehicles adjusting their states according to the MS are assigned. The game starts at the moment when the last vehicle reaches the *Game Area* (we assume length of the *Game Area* is long enough that all vehicles are still in the *Game Area* when game starts) and ends at the moment when there is a vehicle reaching the *Adjusting Area*.

In both gaming period and adjusting period, IDM is adopted to describe the behavior of the following vehicle and we modify this model, such as adding the constraints of acceleration and velocity, to avoid the abrupt state change at the transition moment. As to the assignment of MS, we evaluate each competitor from three aspects based on the three given rules. To ascertain an optimal weight vector which depicts the influence of each rule, we formulate the problem as a double-objective optimization problem of cumulative fuel consumption and total travel time. Since the relationship between the optimization objectives and the weight vector is unknown, we give different weight vectors as input to search the Pareto Solutions and choose the “inflection point” on the *F-T* curve as the best fit of our problem. And finally, we search back for the corresponding weight vector as the solution.

Simulation and comparison of the proposed model and other models are conducted and the effectiveness of our model is validated. However, all the results are obtained based on a series of ideal assumption, including no communication, vehicle dynamic delay, etc. Further exploration is needed on the use of feedback control to improve the accuracy, considering the environmental noise and disturbance. Besides, lateral control to the vehicle should also be considered when extending the model to the practical implementation in the future work.

#### Data Availability

The original codes of the numerical tests used to support the findings of this study are available from the corresponding author upon request.

#### Conflicts of Interest

The authors declare that they have no conflicts of interests.

#### Authors’ Contributions

Xiangmo Zhao and Haigen Min conceived and designed the research. Xiaochi Li and Runmin Wang performed the experiments. Haigen Min and Yukun Fang analysed the data. Haigen Min and Yukun Fang wrote the manuscript. All authors read and approved the final manuscript.

#### References

- B. Schrank, B. Eisele, T. Lomax, and J. Bak,
*Urban Mobility Scorecard*, Texas A&M Transp. Inst., College Station, TX, USA, 2015. - L. Xu, C. Feng, V. R. Kamat, and C. C. Menassa, “An occupancy grid mapping enhanced visual SLAM for real-time locating applications in indoor GPS-denied environments,”
*Automation in Construction*, vol. 104, pp. 230–245, 2019. View at: Publisher Site | Google Scholar - M. Yang, B. Ai, R. He et al., “Influence of different antenna locations on channel characterization for V2V communications,” in
*Proceedings of the 2018 IEEE Antennas and Propagation Society International Symposium and USNC/URSI National Radio Science Meeting*, pp. 377-378, Boston, MA, USA, July 2018. View at: Google Scholar - I. Kabashkin, “Reliable v2x communications for safety-critical intelligent transport systems,” in
*Proceedings of the 2017 Advances in Wireless and Optical Communications (RTUWO)*, pp. 251–255, Riga, Latvia, November 2017. View at: Publisher Site | Google Scholar - L. C. Davis, “Effect of cooperative merging on the synchronous flow phase of traffic,”
*Physica A-Statistical Mechanics and its Applications*, vol. 361, no. 2, pp. 606–618, 2006. View at: Publisher Site | Google Scholar - E. Moradi-Pari, H. N. Mahjoub, H. Kazemi, A. Tahmasbi-Sarvestani, and Y. P. Fallah, “Utilizing model-based communication and control for cooperative automated vehicle applications,”
*IEEE Transactions on Intelligent Vehicles*, vol. 2, no. 1, pp. 38–51, 2017. View at: Publisher Site | Google Scholar - S. E. Li, Y. Zheng, K. Li et al., “Dynamical modeling and distributed control of connected and automated vehicles: challenges and opportunities,”
*IEEE Intelligent Transportation Systems Magazine*, vol. 9, no. 3, pp. 46–58, 2017. View at: Publisher Site | Google Scholar - C. M. Filho, M. H. Terre, and D. F. Wolf, “Safe optimization of highway traffic with robust model predictive control-based cooperative adaptive cruise control,”
*IEEE Transactions on Intelligent Transportation Systems*, vol. 18, no. 11, pp. 3193–3203, 2017. View at: Publisher Site | Google Scholar - O. D AltanG. Wu, M. J. Barth, K. Boriboonsomsin, and J. A. Stark, “GlidePath: eco-friendly automated approach and departure at signalized intersections,”
*IEEE Transactions on Intelligent Vehicles*, vol. 2, no. 4, pp. 266–277, 2017. View at: Publisher Site | Google Scholar - D. Bevly, X. Cao, M. Gordon et al., “Lane change and merge maneuvers for connected and automated vehicles: a survey,”
*IEEE Transactions on Intelligent Vehicles*, vol. 1, no. 1, pp. 105–120, 2016. View at: Publisher Site | Google Scholar - H. Hadj-Salem, J. M. Blosseville, and M. Papageorgiou, “ALINEA: a local feedback control law for on-ramp metering; a real-life study,” in
*Proceedings of the Third International Conference on Road Traffic Control*, pp. 194–198, London, UK, 1990. View at: Publisher Site | Google Scholar - M. Papagcorgiou and A. Kotsialos, “Frecway ramp metering: an overview,”
*IEEE Transactions on Intelligent Transportation Systems*, vol. 3, no. 4, pp. 271–281, 2002. View at: Publisher Site | Google Scholar - E. Smaragdis, M. Papageorgiou, and E. Kosmalopoulos, “A flow-maximizing adaptive local ramp metering strategy,”
*Transportation Research Part B: Methodological*, vol. 38, no. 3, pp. 251–270, 2004. View at: Publisher Site | Google Scholar - I. Papamichail and M. Papageorgiou, “Traffic-responsive linked ramp-metering control,”
*IEEE Transactions on Intelligent Transportation Systems*, vol. 9, no. 1, pp. 111–121, 2008. View at: Publisher Site | Google Scholar - R. C. Carlson, L. Papamichail, and M. Papageorgiou, “Local feedkack-based mainstream traffic flow control on motorways using variable speed limits,”
*IEEE Transactions on Intelligent Transportation Systems*, vol. 12, no. 4, pp. 1261–1276, 2011. View at: Publisher Site | Google Scholar - K. Dresner and P. Stone, “Multiagent traffic management: a reservation-based intersection control mcchanism,” in
*Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems*, pp. 530–537, New York, NY, USA, July 2004. View at: Google Scholar - J. Rios-Torres and A. A. Malikopoulos, “A survery on the coordination of Connected and automated vehicles at intersections and merging at Highway on-ramps,”
*IEEE Transactions on Intelligent Transportation Systems*, vol. 18, no. 5, pp. 1066–1077, 2017. View at: Publisher Site | Google Scholar - K. Dresner and P. Stone, “A multiagent approach to autonomous inter-section management,”
*Journal of Artificial Intelligence Research*, vol. 31, no. 1, pp. 591–653, 2008. View at: Publisher Site | Google Scholar - T.-C. Au, P. Stone, and M. Hausknecht, “Motion planning algorithms for autonomous intersection management,” in
*Proceedings of the AAAI Workshop Bridging Gap BTAMP*, pp. 1–8, Seattle, WA, USA, 2010. View at: Google Scholar - I. A. Ntousakis, K. Porfyri, I. K. Nikolos, and M. Papageorgiou, “Assessing the impact of a coperative merging system on highway traffic using amicroscopic flow simulator,” in
*Proceedings of the International Mechanical Engineering Congress and Exposition*, pp. 1–10, Montreal, Quebec, Canada, November 2014. View at: Google Scholar - W. Cao, M. Mukai, T. Kawabe, H. Nishira, and N. Fujiki, “Coperative vehicle path generation during merging using model predictive control with real time optimization,”
*Control Engineering Practice*, vol. 34, pp. 98–105, 2015. View at: Publisher Site | Google Scholar - I. A. Ntousakis, I. K. Nikolos, and M. papagcorgiou, “Optimal vehicle trajectory planning in the context of cooperative merging on highways,”
*Transportation Research Part C: Emerging Technologies*, vol. 71, pp. 464–488, 2018. View at: Publisher Site | Google Scholar - T. Awal, L. kulik, and K. Ramamohanrao, “Optimal traffic merging strategy for communication-and sensor-enabled vehicles,” in
*Proceedings of the 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013)*, pp. 1468–1474, The hague, Netherlands, October 2013. View at: Publisher Site | Google Scholar - S. Jing, F. Hui, X. Zhao, J. Rios-Torres, and A. J. Khattak, “Cooperative game approach to optimal merging sequence and on-ramp merging control of connected and automated vehicles,”
*IEEE Transactions on Intelligent Transportation Systems*, vol. 20, no. 11, pp. 4234–4244, 2019. View at: Publisher Site | Google Scholar - D. Sun, Y. He, M. Zhao, and S. Cheng, “Cooperative driving modelling in the vicinity of traffic signals based on intelligent driver model,”
*IET Intelligent Transport Systems*, vol. 12, no. 10, pp. 1236–1242, 2018. View at: Publisher Site | Google Scholar - J. Rios-Torres and A. A. Malikopoulos, “Automated and cooperative vehicle merging at highway on-ramps,”
*IEEE Transactions on Intelligent Transportation Systems*, vol. 18, no. 4, pp. 780–789, 2017. View at: Publisher Site | Google Scholar - M. Kamal, M. Mukai, J. Murata, and T. Kawabe, “Model predictive control of vehicles on urban roads for improved fuel economy,”
*IEEE Transactions on Control Systems Technology*, vol. 21, no. 3, pp. 831–841, 2013. View at: Publisher Site | Google Scholar - W. Zhao, N. Dong, S. Simon, R. Liu, and M. Papageorgiou, “A platoon based cooperative eco-driving model for mixed automated and human-driven vehicles at a signalised intersection,”
*Transportation Research Part C: Emerging Technologies*, vol. 95, pp. 802–821, 2018. View at: Publisher Site | Google Scholar - S. Boyd and L. Vandenberghe,
*Convex Optimization*, Cambridge University Press, Cambridge, UK, 1st edition, 2004. - H. Liu, H. Wei, T. Zuo, Z. Li, and Y. J. Yang, “Fine-tuning ADAS algorithm parameters for optimizing traffic safety and mobility in connected vehicle environment,”
*Transportation Research Part C: Emerging Technologies*, vol. 76, pp. 132–149, 2017. View at: Publisher Site | Google Scholar

#### Copyright

Copyright © 2020 Haigen Min et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.