Abstract
Portfolio optimization that allows the borrowed money from a loan to be invested in risk assets has been formulated as a chance constrained problem. In this paper, in order to reflect investor preferences called “values” in the solution, or the portfolio, prospect theory is used to expand the chance constrained problem that maximizes the profit. The new portfolio optimization problem maximizes the value instead of the profit. In order to get a deeper understanding of the characteristics of the new portfolio optimization problem, the fitness landscape analysis method using Convex-Hull Mapping (CHM) is employed. Furthermore, since the new portfolio optimization problem is usually non-convex, the multi-start local search method with CHM is used to find the solution. Finally, numerical experiments on artificial and actual asset data sets show that the solution of the new portfolio optimization problem is more acceptable to investors than the solution of the conventional one.
1. Introduction
Portfolio optimization is the process of determining the best proportion of investment in different assets according to some objective. Since portfolio optimization is one of the most challenging problems in the field of finance, a large number of works about portfolio optimization have been reported [Citation1–11]. In these works, in order to maximize profits such as expected return or minimize costs such as financial risk, portfolio optimization has been formulated as various optimization problems.
In recent years, the economic stimulus package known as “low-interest monetary policy” has kept interest rates of bank deposits and loans very low in Japan. Thus, we have been studying the portfolio optimization that allows the borrowed money from a loan to be invested in risk assets. In our previous work [Citation12,Citation13], the portfolio optimization using loan has been formulated as a chance constrained problem that maximizes the profit. Then it has been proven that the portfolio optimization problem using loan is the convex optimization problem, and the optimal solution, or the best portfolio, is either not to borrow money at all or to borrow money as much as possible.
Prospect theory is a theory of behavioural economics and decision making that was developed by two psychologists: Kahneman and Tversky [Citation14,Citation15]. The theory provides the best available description of how people evaluate risk under uncertainties. Therefore, prospect theory has been used to formulate several portfolio optimization problems [Citation16–21]. Prospect theory can be summarized by two functions: the value function and the probability weighting function. The former provides a nonlinear mapping from profits to human preferences called “values.” The latter provides a mapping from objective probabilities to weighted probabilities.
By using the two functions of prospect theory, this paper expands the conventional portfolio optimization problem using loan [Citation12,Citation13] to reflect investor preferences, or “values,” in the solution. Specifically, the new portfolio optimization problem using loan maximizes the value, while the conventional one maximizes the profit.
In order to get a deeper understanding of the characteristics of the new portfolio optimization problem in comparison with the conventional one, two methods previously proposed by the authors are used. The first one is the fitness landscape analysis method using Convex-Hull Mapping (CHM) [Citation22]. The second one is the multi-start local search method with CHM [Citation23]. The constraint-handling technique called CHM [Citation24] generates a set of feasible solutions randomly. By using the two methods, the relationship between the profit and the value of the portfolio using loan is examined on artificial and actual asset data sets. As a result, it is revealed that the solution of the new portfolio optimization problem is more acceptable to investors.
This paper is an extended version of the paper presented in the SICE Annual Conference 2023 [Citation22] and differs from the paper in the following four points.
The advantages of the proposed prospect theory-based portfolio optimization problem over traditional prospect theory-based ones are discussed.
The effects of the interest rate and upper limit of the loan on the solution of the new prospect theory-based portfolio optimization problem are evaluated.
The multi-start local search method [Citation23] is addressed in detail.
The proposed methodology is applied to actual asset data of Japanese stock market (TOPIX Large 70) and validated.
The remainder of this paper is organized as follows. Previous studies about prospect theory-based portfolio optimization problems are presented in Section 2. Then the uniqueness and advantages of the proposed problem formulation based on prospect theory are discussed. Portfolio optimization problem using loan is formulated as a chance constrained problem that maximizes the profit in Section 3. Then the chance constrained problem is transformed into a deterministic optimization problem without the chance constraint in Section 4. Section 5 explains the two functions of prospect theory: the value one and the probability weighting one. Section 6 formulates the prospect theory-based portfolio optimization problem using loan that maximizes the value of the portfolio instead of the profit. Section 7 explains the fitness landscape analysis method and the multi-start local search method using CHM. The results of numerical experiments on artificial asset data are shown in Section 8. The proposed methodology is applied to actual asset data from Japanese stock market and validated in Section 9. Section 10 concludes this paper and discusses future work.
2. Related works
Portfolio optimization is the process of determining the best portion of investment in different risk assets according to some objective. As mentioned above, since portfolio optimization is one of the most challenging problems in the field of finance [Citation8], a large number of problem formulations have been reported [Citation1–11]. Generally speaking, the traditional problem formulations of portfolio optimization can be divided into two groups: deterministic formulations and stochastic formulations.
The best-known Markowitz's model [Citation1] is deterministic. In Markowitz's model, the risk of the portfolio is evaluated by the variance of returns. Then the risk is minimized under the constraint about the expected return. Considering the trade-off between the risk and the return, Markowitz's model has been expanded in various ways and many deterministic formulations of portfolio optimization have been reported [Citation5,Citation7]. Furthermore, in order to solve deterministic portfolio optimization problems, not only optimization algorithms of mathematical programming but also heuristic methods such as evolutionary algorithms [Citation6,Citation11,Citation24] have been used effectively.
Kataoka's model [Citation2] is the basic formulation of stochastic ones. In Kataoka's model, portfolio optimization is formulated as a chance constrained problem. Then the risk of the portfolio is evaluated by the failure probability that the return falls below a desired value. By assessing risk in terms of probability rather than variance, the investor can get a concrete picture of risk. Furthermore, the investor can compare multiple portfolios with different failure probabilities. On the other hand, due to chance constraints, it is usually hard to solve stochastic portfolio optimization problems.
We have expanded Kataoka's model to formulate the portfolio optimization using loan as a chance constrained problem [Citation12,Citation13]. Even though various problem formulations have been reported for portfolio optimization, authors' model that allows the borrowed money from a loan to be invested in risk assets is very unique.
Chance constrained problems, which are also referred to as probabilistic constrained problems, have been studied in the field of stochastic programming for many years [Citation25]. In fact, many real-world optimization problems that consider uncertainties to obtain realistic solutions have been formulated as chance constrained problems [Citation26].
Chance constrained problems can be divided into two groups depending on how uncertainty is given. In the first group, uncertainty is described by a mathematical model. Well-known probability distributions, such as normal distribution, are often used for the mathematical model [Citation27,Citation28]. Knowledge of the mathematical model is used effectively not only in the problem formulation but also for solving chance constrained problems. In the second group, uncertainty is given by a set of samples, also called scenarios. The set of samples is usually generated randomly using the Monte Carlo method [Citation29–32]. In real-world optimization problems, observed data are often used as samples [Citation26,Citation33]. In the second group of chance constrained problems, the number of samples is important to guarantee the accuracy of the solution theoretically [Citation34].
Chance constraints are also classified into two groups: individual chance constraints and joint chance constraints. For multiple constraints with uncertainty, the individual chance constrained problem specifies the probability that each of constraints will be satisfied separately. On the other hand, the joint chance constrained problem specifies the probability that all constraints will be satisfied simultaneously. Generally speaking, the joint chance constrained problem is far more difficult than the individual chance constrained problem. Therefore, heuristic methods such as evolutionary algorithms are also used for solving joint chance constrained problems practically [Citation35,Citation36].
The chance constrained problem targeted in this paper specifies the probability that only one constraint will be satisfied. The mathematical model of uncertainty is also given by a normal distribution. That is because the normal distribution is widely used as a mathematical model of asset returns in the field of financial engineering [Citation3]. As a result, by using the distribution function of the standard normal distribution, the chance constrained problem is transformed into a simple deterministic equivalent problem [Citation25]. Then an existing mathematical programming solver is used to obtain the solution of the chance constrained problem targeted in this paper. However, in terms of applications of chance constrained optimization, the proposed problem formulation taking into account human preferences will be applicable to many real-world problems other than the portfolio optimization. Furthermore, probability weighting based on prospect theory has not been reported to the beat of the authors' knowledge.
As mentioned above, prospect theory is an essential theory of behavioural economics and decision making that was developed by two psychologists in 1979 [Citation14]. More than 40 years later, prospect theory is still widely viewed as the best available description of how people evaluate risk. Even though prospect theory has been employed in many applications where attitudes toward risk play a central role [Citation37–39], the theory has been most extensively applied to the fields of finance and insurance [Citation40].
In fact, several problem formulations based on prospect theory have been reported for portfolio optimization [Citation17–21]. The only commonality among the conventional works is that two functions of prospect theory, namely the value function and the probability weighting function, are used in their problem formulations. In portfolio optimization problems, asset returns are regarded as random variables. The return of the portfolio is also a random variable. Some prospect theory-based formulations modify each of asset returns by the two functions [Citation21], while others modify the return of the portfolio by them [Citation20]. Then the investor's utility called “prospect” is calculated from the products of values and weighted probabilities in various ways.
There are three drawbacks to the traditional prospect theory-based formulations of portfolio optimization: (1) It is not realistic for an investor to fully understand and weight the probability distribution of asset returns; (2) The size of the calculated prospect is not directly related to the investor's investment behaviour; (3) Since the optimal solution is uniquely determined as with deterministic portfolio optimization problems, the investor cannot compare multiple solutions with different risks.
The prospect theory-based portfolio optimization problem proposed in this paper is derived from the above chance constrained problem. Therefore, the investor can choose any failure probability that is worth investing in. Then only the acceptable failure probability is converted by the probability weighting function. Therefore, the investor does not need to reassess the probabilities of many asset returns. Since the borrowed money from a loan is invested in risk assets, the loan amount is valuated properly as a loss by the value function. On the other hand, “prospect” is not calculated explicitly in the proposed prospect theory-based portfolio optimization problem.
3. Portfolio optimization using loan
3.1. Definition of portfolio and loan
We invest money in n risk assets. Let , be the amount of money invested in i-asset. The portfolio is defined as . Since none of the assets in the portfolio will be sold over a single-period, , holds. Incidentally, such a portfolio is called the long-only one [Citation4]. Let , be an amount of borrowing money from a loan. The upper limit of the loan is , m>0. The loan is not used if . The loan is used up to the limit if . In this paper, all amounts are normalized by own funds. Therefore, constraints for the portfolio considering the loan amount are (1) (1) For example, if we have 1000USD as own funds to invest, and correspond, respectively, to 200USD and 1300USD. If the upper limit of the loan is given as m = 2, we can borrow up to 2000USD. Furthermore, if the loan amount is , the total investment will increase to 3000USD.
From constraints in (Equation1(1) (1) ), the loan amount for the portfolio is (2) (2) where is a constant vector.
One unit investment in i-asset yields a return . From the efficient-market hypothesis [Citation3], we can suppose that each of asset returns , is normally distributed with mean and variance as (3) (3) If the mean of asset returns in (Equation3(3) (3) ) is for an asset, the asset is not worth investing in. Therefore, we assume that , hold. From (Equation3(3) (3) ), the vector of obeys a multivariable normal distribution as (4) (4) where the mean is given as .
The covariance matrix in (Equation4(4) (4) ) is derived as follows. From standard deviations , in (Equation3(3) (3) ), the diagonal matrix is defined as (5) (5) From correlation coefficients , between and , the coefficient matrix is defined as (6) (6) From in (Equation5(5) (5) ) and in (Equation6(6) (6) ), the covariance matrix in (Equation4(4) (4) ) is obtained as (7) (7) Let , be the fixed interest rate of the loan. Then, from the loan amount in (Equation2(2) (2) ) and in (Equation4(4) (4) ), the return of the portfolio is (8) (8) where the return does not contain explicitly.
The return in (Equation8(8) (8) ) also obeys a normal distribution as (9) (9) where and .
3.2. Formulation of POL
From among various problem formulations contrived for the portfolio optimization [Citation5,Citation8], we have adopted a stochastic one known as Kataoka's model [Citation2]. In other words, Portfolio Optimization problem using Loan (POL) [Citation12,Citation13] is an expanded variant of Kataoka's model.
The risk of the portfolio is evaluated by the probability that the return in (Equation8(8) (8) ) falls below a desired value . Let be the probability that event occurs. Let be the failure probability that is acceptable to the investor. Then POL is formulated as a chance constrained problem: (10) (10) where the loan amount is eliminated from the constraints in (Equation1(1) (1) ) by using the portfolio as shown in (Equation2(2) (2) ).
4. Maximization of profit
4.1. Formulation of POL_P
It is hard to solve POL in (Equation10(10) (10) ) due to the chance constraint. Therefore, POL is transformed into a deterministic problem called POL for maximizing Profit (POL_P).
Since the return of the portfolio is a random variable following the normal distribution in (Equation9(9) (9) ), the chance constraint in (Equation10(10) (10) ) is standardized as (11) (11) The probability in (Equation11(11) (11) ) is also written as (12) (12) where is the Cumulative Distribution Function (CDF) of the standard normal distribution.
From (Equation12(12) (12) ), the deterministic equivalent problem of POL in (Equation10(10) (10) ) is (13) (13) By injecting the soft constraint with into the objective function in (Equation13(13) (13) ), we define POL_P as (14) (14) where and are given in (Equation9(9) (9) ).
The optimal solution of POL_P in (Equation14(14) (14) ) is the portfolio that maximizes the profit under a given . From the mean in (Equation9(9) (9) ), the loan amount is included in the profit . Therefore, the investor may liquidate the debt and still make a profit if . On the other hand, in the case of , the portfolio will not be adopted by the investor.
4.2. Characteristics of POL_P
Since all the constraints of POL_P in (Equation14(14) (14) ) are linear, the feasible region of POL_P is given by a convex polyhedron. Figure illustrates the feasible region of POL_P for the case of n = 2. The feasible region is shown by the gray area between two hyper-planes. If a portfolio does not use the loan at all as , it exists on the lower hyper-plane: . On the other hand, if a portfolio uses the loan up to the limit as , it exists on the upper hyper-plane: .
Theorem 4.1
The objective function of POL_P in (Equation14(14) (14) ) is concave, In other words, is convex [Citation12].
Proof.
See Appendix 1.
From Theorem 4.1, POL_P in (Equation14(14) (14) ) is the convex optimization problem. Therefore, the global optimal solution of POL_P can be obtained by the local search method. The optimal solution of POL_P may or may not use the loan. Furthermore, the loan is used up to the limit if it is used as shown in Theorem 4.2.
Theorem 4.2
The optimal solution of POL_P uses the loan up to the limit if it uses the loan. Specifically, the loan amount in (Equation2(2) (2) ) becomes either or for [Citation13].
Proof.
See Appendix 2.
5. Prospect theory
Prospect theory provides the best available description of how people evaluate risk under uncertainties. Specifically, prospect theory can be summarized by two functions: the value function and the probability weighting function [Citation14,Citation15].
5.1. Value function
The value function provides a nonlinear mapping from profits to human values. Profits are called gains if . Profits are called losses if z<0. Then the value function is defined by a two-part power function as (15) (15) where and [Citation15].
The value function in (Equation15(15) (15) ) represents three elements of prospect theory:
Reference dependence,
Diminishing sensitivity,
Loss aversion.
5.2. Probability weighting function
The fourth element of prospect theory is probability weighting. According to prospect theory, people do not evaluate uncertain profits by their objective probabilities but rather by weighted probabilities. More specifically, people generally overestimate low probabilities and underestimate high probabilities.
The probability weighting function provides a nonlinear mapping from objective probabilities to weighted ones . In order to represent the above human characteristics, the probability weighting function is defined as (16) (16) where . If c = 1 then holds [Citation15].
Figure shows the probability weighting function with c = 0.6.
6. Maximization of value
6.1. Gain and loss of portfolio
By using the probability weighting function in (Equation16(16) (16) ), the failure probability is weighted as . Then the profit in (Equation14(14) (14) ) is expanded to (17) (17)
Theorem 6.1
The probability weighting function in (Equation16(16) (16) ) returns the weighted probability within the range for the failure probability given from the range .
Proof.
The weighted probability for is (18) (18) where .
From c>0 in (Equation16(16) (16) ), h>1 holds in (Equation18(18) (18) ). Thus, we obtain (19) (19) Since the probability weighting function in (Equation16(16) (16) ) is an increasing one, it returns the weighted probability for the failure probability .
The profit in (Equation17(17) (17) ) is divided into two parts as (20) (20) From and , , we can see that holds in (Equation20(20) (20) ). Therefore, is the gain of the portfolio . On the other hand, from Theorem 6.1, holds for . Furthermore, from , holds in (Equation20(20) (20) ). Therefore, is the loss of the portfolio .
6.2. Formulation of POL_V
According to prospect theory, POL_P in (Equation14(14) (14) ) will be expanded to POL for maximizing Value (POL_V). By using the value function in (Equation15(15) (15) ), the value of the gain in (Equation20(20) (20) ) can be evaluated as (21) (21) On the other hand, by using the value function in (Equation15(15) (15) ), the value of the loss in (Equation20(20) (20) ) can be evaluated as (22) (22) From (Equation21(21) (21) ) and (Equation22(22) (22) ), the value of the portfolio is defined as (23) (23) From POL_P in (Equation14(14) (14) ) and (Equation23(23) (23) ), POL_V is formulated as (24) (24) The optimal solution of POL_V in (Equation24(24) (24) ) is the portfolio that maximizes the value for the investment under a given . However, in the case of , the portfolio will not be adopted by the investor.
The objective functions of POL_V in (Equation24(24) (24) ) and POL_P in (Equation14(14) (14) ) are the same as if holds for the functions in (Equation15(15) (15) ) and (Equation16(16) (16) ). Therefore, POL_V in (Equation24(24) (24) ) is an expanded variant of POL_P in (Equation14(14) (14) ).
From Theorem 4.1, the profit in (Equation14(14) (14) ) is concave. On the other hand, the value function in (Equation15(15) (15) ) is convex for . Thus, the objective function of POL_V in (Equation24(24) (24) ) is usually neither concave nor convex. It means that POL_V is the non-convex optimization problem which may possibly has multiple local optimal solutions.
7. Optimization method
7.1. Convex-Hull mapping
Convex-Hull Mapping (CHM) [Citation24] can generate feasible solutions randomly for a sort of constrained optimization problems. Let be the feasible region of the constrained optimization problem. We assume that the feasible region is a convex polyhedron and all vertexes of are known.
Let , be the set of the vertexes of the feasible region . Then CHM generates a feasible solution randomly as follows:
Step 1: | Generate uniformly distributed random numbers , where q is determined from the number of vertexes p as q = p−1. | ||||
Step 2: | Sort in ascending order as (25) (25) | ||||
Step 3: | Get coefficients , as (26) (26) | ||||
Step 4: | Compose a feasible solution as (27) (27) where holds. |
7.2. Landscape analysis method
Over past few decades, as a powerful analytical tool to reveal the structure of the decision variable space, the fitness landscape analysis has been widely concerned and utilized for all kinds of optimization areas [Citation41].
We have proposed the fitness landscape analysis method using CHM for POL_P and POL_V [Citation22]. The feasible regions of POL_P and POL_V are the same. The feasible region is given by a convex polyhedron as shown in Figure . In the proposed landscape analysis method, a large number of feasible solutions are generated randomly by CHM. Then these solutions are mapped to the objective function space . Therefore, we can estimate the structure of the feasible region from the objective function space.
The same feasible region in POL_P and POL_V can be represented by the following p = 2n vertexes , : (28) (28) where , m>0 is the upper limit of the loan.
From all vertexes in (Equation28(28) (28) ), CHM generates a set of feasible solutions to analyse the overall structure of the feasible region . Figure shows a set of 100 feasible solutions , generated by CHM in the feasible region with n = 2 and m = 2. From Figure , we can see that all solutions are uniformly distributed in the feasible region .
From (Equation2(2) (2) ), the feasible solution , or the portfolio , using the loan totalling exists on the hyper-plane: (29) (29) CHM can also generate a set of feasible solutions randomly on the hyper-plane in (Equation29(29) (29) ) from the following p = n vertexes , : (30) (30) The hyper-plane in (Equation29(29) (29) ) is a cross-section of the feasible region. Therefore, the structure of the feasible region can be also analysed by a large number of solutions generated on hyper-planes with various values of .
7.3. Multi-start local search method
Since POL_V in (Equation24(24) (24) ) is the non-convex optimization problem, the solution obtained by the local search method depends on the initial solution. Therefore, in order to find a solution as close as possible to the optimal solution of POL_V, the multi-start local search method uses a set of various initial solutions generated by CHM [Citation23].
Let K be the number of initial solutions. The algorithm of the multi-start local search method is described as follows:
Step 1: | From the vertexes , in (Equation28(28) (28) ), generate a set of feasible initial solutions , randomly by using CHM. | ||||
Step 2: | Apply the local search method to each of the feasible initial solutions , . Then obtain K local optimal solutions . | ||||
Step 3: | Select the best solution from among the set of local optimal solutions , . |
8. Numerical experiments
8.1. Artificial data of asset returns
By using artificial data of n = 4 asset returns, the characteristics of POL_V are clarified in comparison with POL_P. Table shows the mean and standard deviation of each asset return , . Table shows the correlation coefficient between and . The values of , , and are used for and in (Equation4(4) (4) ).
For the value function in (Equation15(15) (15) ) and the probability weighting function in (Equation16(16) (16) ), we adopt the parameter values proposed by Tversky and Kahneman in their paper [Citation15], as listed in Table . In fact, the parameter values in Table have been widely used in prospect theory-based portfolio optimization problems [Citation18,Citation19]. That is because these values have been theoretically and empirically verified [Citation20].
8.2. Fitness landscape analysis
By using CHM with vertexes in (Equation28(28) (28) ) and (Equation30(30) (30) ), a huge number of solutions are generated within the feasible region and on the hyper-plain in (Equation29(29) (29) ). Then pairs of profits and values, or points , are evaluated for them.
Firstly, the interest rate and upper limit of the loan are fixed as L = 0.01 and m = 2. From Theorem 4.2, the optimal solution of POL_P uses the loan up to the limit if it uses the loan. Therefore, we are interested in the loan amount spent by the solution of POL_V. Since the size of the feasible region is proportional to the upper limit of the loan , we have chosen m = 2 to assess a sufficiently large area. The failure probability is chosen as , 0.35. Then, by using CHM with vertexes in (Equation28(28) (28) ), a set of solutions is generated randomly in the feasible region . Figure shows points evaluated for the set of solutions . As described below, the solutions of POL_P and POL_V are obtained, respectively, by the multi-start local search method. Figure also shows the points evaluated for the best solutions of POL_P (×) and POL_V (•).
Furthermore, the loan amount is chosen as , 0 for vertexes in (Equation30(30) (30) ). Then a set of solutions is generated randomly by CHM on each of the two hyper-planes in (Equation29(29) (29) ). Figure shows points evaluated for the feasible solutions on the two hyper-planes.
From Figures and , values are generally proportional to profits . In other words, the greater the profit, the greater the value. However, we can see the conflict between the two best solutions to in Figure (a). By the way, the range of profits is wider for rather than for . That is because holds for the profit in (Equation14(14) (14) ).
Secondly, the interest rate and upper limit of the loan are fixed as L = 0.04 and m = 2. The failure probability is chosen as , 0.35. In the same way with Figure , Figure shows points evaluated for the solutions in the feasible region. Figure also shows points evaluated for the best solutions of POL_P (×) and POL_V (•). In the same way with Figure , Figure shows points evaluated for the solutions on the two hyper-planes.
The distributions of points in Figures and are almost the same as those of Figures and , respectively. However, we can see the conflict between the two best solutions to in Figure (b), not in Figure (a) of .
8.3. Solutions of POL_P and POL_V
The solutions of POL_P in (Equation14(14) (14) ) and POL_V in (Equation24(24) (24) ) are obtained, respectively, by the multi-start local search method using K = 30 initial solutions.
Firstly, the interest rate and upper limit of the loan are fixed as L = 0.01 and m = 2. Figure shows the profits achieved, respectively, by the solutions of POL_P (×) and POL_V (•). The horizontal axis of Figure is the failure probability . Similarly, Figure shows the values achieved by the two kinds of solutions. Figure shows the loan amounts spent by the two kinds of solutions. Incidentally, Figure shows the efficient frontier of modern portfolio theory [Citation8], i.e. the trade-off between the profit and the risk measured by .
From Figures and , both the profit and the value increase in proportion to the failure probability. We can also confirm the difference between the two kinds of solutions, especially when the failure probability is small: . Specifically, the solution of POL_P is better than the solution of POL_V in terms of profit. The solution of POL_V is better than the solution of POL_P in terms of value. On the other hand, there is no clear difference between the two kinds of solutions when the failure probability is large: . From Figure , we can see that the inconsistency between the profit and the value is caused by the difference in loan amounts. The solution of POL_V does not use the loan () if . On the other hand, the solution of POL_P uses the loan up to the limit () for every .
Secondly, the interest rate and upper limit of the loan are fixed as L = 0.04 and m = 2. In the same way as Figure through Figure , Figure shows the profits achieved by the solutions of POL_P (×) and POL_V (•) for failure probabilities . Figure shows the values achieved by the two kinds of solutions. Figure shows the loan amounts spent by the two kinds of solutions.
From Figures and , we can confirm the difference between the two kinds of solutions, especially when the failure probability is large. However, there is no clear difference between the two kinds of solutions when the failure probability is small. From Figure , we can see that the inconsistency between the profit and the value is caused by the difference in loan amounts. The solution of POL_V does not use the loan () at all. On the other hand, the solution of POL_P uses the loan up to the limit () if the failure probability is large. By using the loan, the profit of the solution of POL_P increases in Figure . However, the value of the same solution of POL_P drops significantly and becomes negative in Figure . That is because the value function in (Equation15(15) (15) ) evaluates the loss much larger than the gain.
If the value of the solution is negative, the investor will not want to use the portfolio even if it is profitable. From Figures and , we can see that the solutions of POL_P are not desired by the investor in many cases.
8.4. Characteristics of POL_V
By using the multi-start local search method with K = 30 initial solutions, the best solutions of POL_V in (Equation24(24) (24) ) are obtained under several conditions. Then the characteristics of POL_V are clarified through the analysis of those solutions.
Firstly, in order to assess the effect of the interest rate of the loan on the solution of POL_V, the upper limit of the loan is fixed as m = 2. Then the solutions of POL_V are obtained for L = 0, 0.01, and 0.04. Figure shows the profits achieved by the solutions of POL_V with three different interest rates. The horizontal axis of Figure is the failure probability . Similarly, Figure shows the values achieved by the three kinds of solutions of POL_V. Figure shows the loan amounts spent by the three kinds of solutions of POL_V.
Secondly, in order to assess the effect of the upper limit of the loan on the solution of POL_V, the interest rate of the loan is fixed as L = 0.01. Then the solutions of POL_V are obtained for m = 1, 2, and 4. Figure shows the profits achieved by the solutions of POL_V with three different loan limits. The horizontal axis of Figure is the failure probability . Figure shows the values achieved by the three kinds of solutions of POL_V. Figure shows the loan amounts spent by the three kinds of solutions of POL_V.
From Figures and , the profit of the solution of POL_V increases in proportion to the failure probability. Furthermore, the profit increases rapidly when the loan is used. From Figure , the smaller the interest rate, the greater the profit. From Figure , the greater the loan amount, the greater the profit.
From Figures and , the value of the solution of POL_V increases in proportion to the failure probability as well as the profit. The greater the profit, the greater the value. However, the value does not increase rapidly even if the loan is used. The increase in values is very moderate compared to the increase in profits.
From Figures and , the solution of POL_V uses the loan up to the limit () when it uses the loan. At that time, the solution of POL_V exists on the upper hyper-plane: . In fact, we have confirmed experimentally that the loan is used up to the limit even if the upper limit is given as m = 10.
Figure , we can see that the interest rate determines whether the loan is used or not. The loan with L = 0.04 is not used for any . On the other hand, the loan with L = 0 is used for all except .
9. Real world application
9.1. Actual data of asset returns
The proposed methodology is applied to historical asset data of Japanese stock market. First of all, in order to obtain the multivariable normal distribution in (Equation4(4) (4) ), or the mathematical model of asset returns, we used 60 monthly data (from January 2018 to December 2022) of TOPIX (Tokyo Stock Price Index) Large 70 published by Toyo Keizai Inc. From 70 assets included in TOPIX Large 70, we selected top n = 30 assets in descending order of the mean of asset return in (Equation3(3) (3) ).
Figure shows the means of the top 30 asset returns. Even though profits from investments include capital gains and income gains, income gains are not taken into account in the means in Figure . Therefore, we have added the average income gain of Japanese stocks, i.e. 0.02, uniformly to all means in Figure . Figure also shows the standard deviations of the top 30 asset returns. By using the Kolmogorov–Smirnov test [Citation43], we have verified the normality of the top 30 asset returns with significance level: 0.05. As a result, we have confirmed that every asset return can be regarded as following a normal distribution.
9.2. Performance of optimization method
The multi-start local search method is used to solve POL_P in (Equation14(14) (14) ) and POL_V in (Equation24(24) (24) ), which are defined with the above mathematical model. Since the set of initial solutions are generated randomly, the solution obtained by the multi-start local search method depends not only on the number of initial solutions, but also on the random seed. Of course, the solution also depends on the failure probability . In order to determine an appropriate number of initial solutions K, we have statistically evaluated the effect of K on the solution of POL_V with L = 0.001 and m = 2.
The multi-start local search method using MATLAB solver [Citation42] is applied to POL_V with K = 10, 30, 90 and , 0.35. The local optimality and feasibility of the solution obtained by MATLAB solver are guaranteed based on Karush–Kuhn–Tucker (KKT) conditions. For each case, 20 best solutions are obtained by the proposed method with different random seeds. The mean and standard deviation (within parentheses) of the values of them are summarized in Table .
For each of in Table , there is no difference in the mean values due to difference in the figures of K. The standard deviations of are also very small. From Table , the best solutions obtained by multi-start local search method seem to converge sufficiently to the global optimal solution of POL_V.
The computation time for the multi-start local search method is proportional to the number of initial solutions. From Table , we adopt K = 30 for the method because it seems to be sufficient for a practical analysis of the solution of POL_V.
9.3. Comparison of POL_P and POL_V
In both of POL_P and POL_V, the upper limit of the loan is fixed as m = 2. For the functions in (Equation15(15) (15) ) and (Equation16(16) (16) ), the parameter values in Table are used.
Firstly, the interest rate of the loan is fixed as L = 0.001. Figure shows the profits achieved, respectively, by the solutions of POL_P (×) and POL_V (•). The horizontal axis of Figure indicates the failure probability . Similarly, Figure shows the values achieved by the two kinds of solutions. Figure shows the loan amounts spent by the two kinds of solutions.
From Figure , the solution of POL_P uses the loan for , while the solution of POL_V uses the loan for . From Figures and , the use of loan clearly increases the profits of the solutions of POL_P and POL_V.
From Figures and , we can see the inconsistency between the profit and the value when the failure probability is large: . Especially, the value of the solution of POL_P drops significantly in Figure when the solution uses the loan in Figure . In order to analyse the phenomenon observed in Figure , we have examined the components of the values achieved by the two kinds of solutions.
Figure shows the gain , loss , and value for the solution of POL_P in Figure . Figure also shows the gain , loss , and value for the solution of POL_V in Figure . From Figures and , both gains and losses increase sharply when the loan is used in Figure . From Figure , the increase in loss is greater than the increase in gain for the solution of POL_P. That is because the value function in (Equation15(15) (15) ) evaluates the loss much larger than the gain. Furthermore, the solution of POL_P uses the loan even if the failure probability is small. As a result, the value for the solution of POL_P drops significantly in Figure .
Figure shows the profits in Figure and the values in Figure for the solutions of POL_P and POL_V. From Figure , the value for the solution of POL_V increases in proportion to the profit. On the other hand, the value for the solution of POL_P does not increase in proportion to the profit. Therefore, the solution of POL_P creates a conflict between the profit and the value.
Secondly, the interest rate of the loan is raised and fixed as L = 0.004. In the same way as Figures through , Figures through compare the solution of POL_V (•) with the solution of POL_P (×).
Figure shows the loan amounts spent by the two kinds of solutions. From Figure , the solution of POL_V does not use the loan at all. Therefore, the increase of the profit in Figure is moderate for the failure probability . The solution of POL_P uses the loan up to the limit () for . As a result, the profit rises sharply in Figure . However, the value drops significantly in Figure when the loan is used in Figure . The loss for the solution of POL_L in Figure is much larger than the loss for the solution of POL_V in Figure . Furthermore, the loss is much larger than the gain in Figure .
Figure shows the profits in Figure and the values in Figure for the solutions of POL_P and POL_V. From Figure , the value for the solution of POL_V increases in proportion to the profit. On the other hand, the value for the solution of POL_P does not increase in proportion to the profit. Therefore, the solution of POL_P creates a conflict between the profit and the value.
A portfolio in which either the profit or the value is negative will not be adopted by investors. Since the value of the solution of POL_P is negative for any in both Figures and , we can conclude that the solution of POL_V is more acceptable to investors than the solution of POL_P. We can also say that the use of the loan with lower interest rate is effective to increase the value of the portfolio.
10. Conclusion
The portfolio optimization problem that allows the borrowed money from a loan to be invested in risk assets has been formulated as a chance constrained problem [Citation12].
First of all, the chance constrained problem is transformed into a deterministic optimization problem called POL_P. The optimal solution of POL_P is the portfolio that maximizes the profit under a given failure probability .
In order to reflect investor preferences called “values” in the portfolio, POL_P has been expanded to POL_V based on prospect theory. Prospect theory [Citation14,Citation15] can be summarized by two functions, namely, the value function and the probability weighting function. Therefore, the failure probability is transformed into the weighted one by the probability weighting function. Then the profit of the portfolio is also transformed into the value by the value function. The optimal solution of POL_V is the portfolio that maximizes the value under a given failure probability.
CHM proposed by authors [Citation24] can generate a set of solutions randomly in the feasible regions of POL_P and POL_V. In order to have an in-depth understanding of the characteristics of POL_V in comparison with POL_P, the fitness landscape analysis method using CHM [Citation22] is employed. Furthermore, it is shown mathematically that POL_V is the non-convex optimization problem. Therefore, the multi-start local search method with CHM [Citation23] is also used to solve POL_V effectively.
Through the numerical experiments conducted on artificial and actual asset data sets, the solution of POL_V is compared with the solution of POL_P. As a result, the characteristics of POL_V are revealed as follows:
Even if the solution of POL_P uses the loan to maximize the profit, the solution of POL_V does not always use the loan to maximize the value in the same condition. As a result, the conflict between the profit and the value, i.e. and , is observed in many cases.
Whether or not the solution of POL_V uses the loan depends on the failure probability and the interest rate of the loan. Since the solution of POL_V is risk averse, it does not use the loan if the failure probability is small. Also, the loan is not used by the solution if the interest rate is high.
From Figures and , the loan is effectively used by the solution of POL_V to increase the value if the conditions are right.
From Theorem 4.1, the solution of POL_P uses the loan up to the limit if it uses the loan. From Figures and , it is experimentally confirmed that the solution of POL_V also uses the loan up to the limit if it uses the loan.
From Figures and , the solution of POL_V is more practical than the solution of POL_P. That is because the value does not increase in proportion to the profit and decreases in some cases, while the value always increases in proportion to the profit .
In this paper, the mathematical model of asset returns is provided by a normal distribution. However, the normality of data on asset returns is not always guaranteed. Therefore, in future work, the prospect theory-based portfolio optimization problem using loan should be formulated as a sample-based chance constrained problem and solved with advanced methods [Citation29–32]. Furthermore, we would like to theoretically prove the properties of POL_V that we have experimentally clarified in this paper.
Acknowledgments
We are grateful for the valuable comments and suggestions received from anonymous reviewers. These contributed highly to the improvement of this paper.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Additional information
Funding
Notes on contributors
Kiyoharu Tagawa
Kiyoharu Tagawa received his Ph. D. degree from Kobe University, Japan, in 1997. He is a professor in Kindai University, Japan since 2007. His current research interests include system modeling, decision making, optimization methods under uncertainties, and their applications to real-world problems. He is a member of SICE, IEEJ, IPSJ, and IEEE.
Yukiko Orito
Yukiko Orito received her Ph.D. degree from Tokyo Metropolitan Institute of Technology in 2003. She is an associate professor in College of Engineering, Tamagawa University, Japan since 2022. Her current research interests are in evolutionary algorithms and its applications to engineering, finance, and economics. She is a member of IEEJ, JSEC, IPSJ and IEEE.
References
- Markowitz H. Portfolio selection. J Finance. 1952;7(1):77–91. Available from: https://www.iaras.org/iaras/filedownloads/ijmcm/2017/001-0009(2017).pdf
- Kataoka S. Stochastic programming model. Econometrica. 1963;31(1/2):181–196. doi: 10.2307/1910956
- Fama EF. Efficient capital markets: a review of theory and empirical work. J Finance. 1970;25(2):383–417. doi: 10.2307/2325486
- Jacobs BI, Levy KN, Markowitz HM. Trimability and fast optimization of long-short portfolios. Financ Anal J. 2006;62(2):36–46. doi: 10.2469/faj.v62.n2.4082
- Luenberger DG. Investment science. New York: Oxford University Press; 2009.
- Golmakani HR, Fazel M. Constrained portfolio selection using particle swarm optimization. Expert Syst Appl. 2011;38(7):8327–8335. doi: 10.1016/j.eswa.2011.01.020
- Mokhtar M, Shuib A, Mohamad D. Mathematical programming models for portfolio optimization problem: a review. Int J Math Comput Sci. 2014;8(2):428–435. doi: 10.5281/zenodo.1090649
- Elton EJ, Gruber MJ, Brown SJ, et al. Modern portfolio theory and investment analysis. 9th ed.Hoboken (NJ): John Wiley & Sons; 2014.
- Tagawa K. Chebyshev inequality based approach to chance constrained portfolio optimization. Int J Math Comput Methods. 2017;2:66–71.
- Kizys R, Doering J, Juan AA, et al. A simheuristic algorithm for the portfolio optimization problem with random returns and noisy covariances. Comput Oper Res. 2022;136:1–13. doi: 10.1016/j.cor.2021.105631
- Kuo SY, Jiang YC, Lai YT, et al. A new portfolio optimization model considering hybrid trading strategies. In: Proceedings of 2023 IEEE Congress on Evolutionary Computation; 2023. p. 1–10. Jul. 1-5, 2023, Chicago, USA
- Tagawa K. Chance constrained portfolio optimization using loan. In: Proceedings of The Twelfth International Conference on Information, Process, and Knowledge Management; 2020. p. 34–39. Nov. 21-25, 2020, Valencia, Spain
- Tagawa K. An interest rate decision method for risk-averse portfolio optimization using loan. In: Proceedings of the 5th International Conference on Complexity, Future Information Systems and Risk; 2020. p. 15–24. May 8-9, 2020, Online
- Kahneman D, Tversky A. Prospect theory: an analysis of decision under risk. Econometrica. 1979;47(2):263–292. doi: 10.2307/1914185
- Tversky A, Kahneman D. Advances in prospect theory: cumulative representation of uncertainty. J Risk Uncertain. 1992;5(4):297–323. doi: 10.1007/BF00122574
- Giorgi ED, Hens T. Prospect theory and mean-variance analysis: does it make a difference in wealth management? Investment Manage Financ Innovations. 2009;6(1):122–129. doi: 10.5167/uzh-50736
- He XD, Zhou XY. Portfolio choice under cumulative prospect theory: an analytical treatment. Manage Sci. 2011;57(2):315–331. doi: 10.1287/mnsc.1100.1269
- Grishina N, Lucas CA, Date P. Prospect theory based portfolio optimisation: an empirical study and analysis using intelligent algorithms. Quant Finance. 2017;17(3):353–367. doi: 10.1080/14697688.2016.1149611
- Gong C, Xu C, Ando M, et al. A new method of portfolio optimization under cumulative prospect theory. Tsinghua Sci Technol. 2018;23(1):75–86. doi: 10.26599/TST.2018.9010057
- Consigli G, Hitaj A, Mastrogiacomo E. Portfolio choice under cumulative prospect theory: sensitivity analysis and an empirical study. Comput Manage Sci. 2019;16:129–154. doi: 10.1007/s10287-018-0333-x
- Srivastava S, Aggarwal A, Bansal P. Efficiency evaluation of assets and optimal portfolio generation by cross efficiency and cumulative prospect theory. Comput Econ. 2024;63:129–158. doi: 10.1007/s10614-022-10334-7
- Tagawa K, Orito Y. Fitness landscape analysis of prospect theory-based portfolio optimization problem using loan. In: Proceedings of 62nd Annual Conference of the Society of Instrument and Control Engineers of Japan; 2023. p. 878–883. Sep. 6-9, 2023, Tsu, Japan
- Tagawa K, Orito Y. Prospect theory-based formulation of portfolio optimization problem using loan and its solution by multi-start local search. In: Proceedings of 8th International Conference on Business and Industrial Research; 2023. p. 291–296. May 18-19, 2023, Bangkok, Thailand
- Tagawa K, Orito Y. A mapping-based constraint-handling technique for evolutionary algorithms with its applications to portfolio optimization problems. SICE J Control, Measur Syst Integr. 2022;15(1):62–76. doi: 10.1080/18824889.2022.2040268
- Prekopa A. Stochastic programming. Dordrecht: Kluwer Academic Publishers; 1995.
- Uryasev SP. Probabilistic constrained optimization: methodology and applications. Dordrecht: Kluwer Academic Publishers; 2001.
- Nemirovski A, Shapiro A. Convex approximations of chance constrained programs. SIAM J Optim. 2007;17(4):969–996. doi: 10.1137/050622328
- van Ackooij W, Henrion R. Gradient formulae for nonlinear probabilistic constraints with gaussian and gaussian-like distributions. SIAM J Optim. 2014;24(4):1864–1889. doi: 10.1137/130922689
- Luedtke J, Ahmed S. A sample approximation approach for optimization with probabilistic constraints. SIAM J Optim. 2008;19(2):674–699. doi: 10.1137/070702928
- Campi MC, Garatti S. The exact feasibility of randomized solutions of uncertain convex programs. SIAM J Optim. 2008;19(3):1211–1230. doi: 10.1137/07069821X
- Luedtke J, Ahmed S, Nemhauser GL. An integer programming approach for linear programs with probabilistic constraints. In: Proceedings of Integer Programming and Combinatorial Optimization; 2010. p. 410–423. Jun. 9-11, 2010, Lausanne, Switzerland
- Pena-Ordieres A, Luedtke JR, Wachter A. Solving chance-constrained problems via a smooth sample-based nonlinear approximation. SIAM J Optim. 2020;30(3):2221–2250. doi: 10.1137/19M1261985
- Chen Y, Mazhari SM, Chung CY, et al. A preventive dispatching method for high wind power-integrated electrical systems considering probabilistic transient stability constraints. IEEE Open Access J Power Energy. 2021;8:472–483. doi: 10.1109/OAJPE.2021.3098658
- Tempo R, Calafiore G, Dabbene F. Randomized algorithms for analysis and control of uncertain systems. London: Springer-Verlag; 2005.
- Poojari CA, Varghese B. Genetic algorithm based technique for solving chance constrained problems. Eur J Oper Res. 2008;185:1128–1154. doi: 10.1016/j.ejor.2006.06.045
- Tagawa K. An approach to chance constrained problems based on huge data sets using weighted stratified sampling and adaptive differential evolution. MDPI Comput. 2020;9(32):1–20. doi: 10.3390/computers9020032
- Yang C, Liu B, Zhao L, et al. Travelers' risk attitude classification method based on cumulative prospect theory and experimental results. In: Proceedings of IEEE 18th International Conference on Intelligent Transportation Systems; 2015. p. 869–874. Sep. 15 - 18, 2015, Las Palmas, Spain
- Ai G, Deng Y. An overview of prospect theory in travel choice behavior under risk. In: Proceedings of 4th International Conference on Transportation Information and Safety (ICTIS); 2017. p. 1128–1133. Mar. 25–26, 2017, Ahmedabad, India
- Gupta N, Ahirwal MK, Atulkar M. Computational model for human decision making: a study of prospect theory. In: Proceedings of 2018 Conference on Information and Communication Technology; 2018. p. 1–6. Mar. 8-9, 2018, Durban, South Africa
- Barberis NC. Thirty years of prospect theory in economics: a review and assessment. J Econ Perspect. 2013;27(1):173–196. doi: 10.1257/jep.27.1.173
- Zou F, Chen D, Liu H, et al. A survey of fitness landscape analysis for optimization. Neurocomputing. 2022;503:129–139. doi: 10.1016/j.neucom.2022.06.084
- Lopez CP. Matlab optimization techniques. New York, NY: Springer; 2014.
- Massey FJ. The Kolmogorov–Smirnov test for goodness of fit. J Amer Statist Assoc. 1951;49(253):68–78. doi: 10.1080/01621459.1951.10500769
Appendices
Appendix 1.
Proof of Theorem 4.1
Theorem 4.1 is proved from Lemma A.1.
Lemma A.1
The standard deviation in (Equation9(9) (9) ) is convex.
Proof.
Since the covariance matrix in (Equation7(7) (7) ) is positive semi-define, the standard deviation in (Equation9(9) (9) ) can be decomposed as (A1) (A1) where and .
From (EquationA1(A1) (A1) ), is a norm. Therefore, the norm meets the triangle inequality for any as (A2) (A2) where and .
From (EquationA1(A1) (A1) ), the first term of the left side of (EquationA2(A2) (A2) ) can be transformed as (A3) (A3) The second term of the left side of (EquationA2(A2) (A2) ) can be transformed in the same way with (EquationA3(A3) (A3) ). Therefore, (EquationA2(A2) (A2) ) is written as (A4) (A4) From (EquationA4(A4) (A4) ), is convex.
From in (Equation14(14) (14) ), (A5) (A5) From (EquationA4(A4) (A4) ) in Lemma A.1 and for , the right side of (EquationA5(A5) (A5) ) is not positive. Hence, we obtain (A6) (A6) From (EquationA6(A6) (A6) ), the profit in (Equation14(14) (14) ) is concave.
Appendix 2.
Proof of Theorem 4.2
Theorem 4.2 is proved from Lemma A.2.
Lemma A.2
Let be the optimal solution of POL_P under the condition that it does not use the loan: . The optimal solution is improved by borrowing money from the loan if the interest rate of the loan meets the condition: (A7) (A7) where and .
Proof.
Let us think of a new solution , for POL_P. The new solution borrows money from the loan as (A8) (A8) where is the loan amount of .
Incidentally, there is no need to consider the case of for the solution . That is because such a solution is not feasible as .
The profit of the new solution is
(A9) (A9) where .
From (EquationA9(A9) (A9) ), the difference between two profits is (A10) (A10) From (EquationA10(A10) (A10) ) and , holds if the condition in (EquationA7(A7) (A7) ) is satisfied.
Let be a solution of POL_P that uses the loan. From Lemma A.2, (A11) (A11) Let us think of a new solution , for POL_P. The loan amount of the new solution is (A12) (A12) where is the loan amount of .
From (EquationA12(A12) (A12) ), the new solution borrows much money than .
The profit of the new solution is (A13) (A13) From (EquationA13(A13) (A13) ), the difference between two profits is (A14) (A14) From (EquationA11(A11) (A11) ) and , holds for (EquationA14(A14) (A14) ). Therefore, we can increase the profit of by borrowing money as much as possible.
Contrary to , if we think of a new solution , in (EquationA12(A12) (A12) ), the new solution borrows less money than as . Furthermore, from (EquationA11(A11) (A11) ) and , holds for (EquationA14(A14) (A14) ). Therefore, we can confirm that the optimal solution of POL_P uses the loan up to the limit if it uses the loan.