Next Article in Journal
A New Filtering System for Using a Consumer Depth Camera at Close Range
Next Article in Special Issue
Radio Frequency Fingerprint-Based Intelligent Mobile Edge Computing for Internet of Things Authentication
Previous Article in Journal
Urban Design Factors Influencing Surface Urban Heat Island in the High-Density City of Guangzhou Based on the Local Climate Zone
Previous Article in Special Issue
On the Performance of Energy Harvesting Non-Orthogonal Multiple Access Relaying System with Imperfect Channel State Information over Rayleigh Fading Channels
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Machine Learning Approach to Achieving Energy Efficiency in Relay-Assisted LTE-A Downlink System †

1
School of Electrical Engineering and Computer Science, National University of Sciences & Technology (NUST), Islamabad 44000, Pakistan
2
Department of Electrical Engineering, Higher Colleges of Technology, Ruwais Campus 12389, UAE
3
College of Computers and Information Technology, Taif University, Taif 21974, Saudi Arabia
4
Pakistan Institute of Engineering and Applied Sciences (PIEAS), Islamabad 45650, Pakistan
5
Thomas Johann Seebeck Department of Electronics, Tallinn University of Technology, Tallinn 19086, Estonia
*
Author to whom correspondence should be addressed.
This paper is an extended version of our paper published in 16th Biennial Baltic Conference on Electronics and Embedded Systems, Tallinn, Estonia, 8–10 October 2018.
Sensors 2019, 19(16), 3461; https://doi.org/10.3390/s19163461
Submission received: 7 May 2019 / Revised: 16 July 2019 / Accepted: 22 July 2019 / Published: 8 August 2019
(This article belongs to the Special Issue Green, Energy-Efficient and Sustainable Networks)

Abstract

:
In recent years, Energy Efficiency (EE) has become a critical design metric for cellular systems. In order to achieve EE, a fine balance between throughput and fairness must also be ensured. To this end, in this paper we have presented various resource block (RB) allocation schemes in relay-assisted Long Term Evolution-Advanced (LTE-A) networks. Driven by equal power and Bisection-based Power Allocation (BOPA) algorithm, the Maximum Throughput (MT) and an alternating MT and proportional fairness (PF)-based SAMM (abbreviated with Authors’ names) RB allocation scheme is presented for a single relay. In the case of multiple relays, the dependency of RB and power allocation on relay deployment and users’ association is first addressed through a k-mean clustering approach. Secondly, to reduce the computational cost of RB and power allocation, a two-step neural network (NN) process (SAMM NN) is presented that uses SAMM-based unsupervised learning for RB allocation and BOPA-based supervised learning for power allocation. The results for all the schemes are compared in terms of EE and user throughput. For a single relay, SAMM BOPA offers the best EE, whereas SAMM equal power provides the best fairness. In the case of multiple relays, the results indicate SAMM NN achieves better EE compared to SAMM equal power and BOPA, and it also achieves better throughput fairness compared to MT equal power and MT BOPA.

1. Introduction

Green Radio communication has received a lot of attention in the past few years with an aim to decrease the carbon foot print of wireless networks. It has been estimated that nearly 70% of the energy being used by cellular operators is on the radio part [1] and around 9% of the global CO 2 emission is from the communication systems [2]. In addition, one of the main concerns is the User Equipment (UE) battery, which has not shown progression at par with the Radio Access Technology (RAT). This phenomena is highly visible for the cell edge users that despite spending higher energy (due to high pathloss shadow fading and adjacent cell interference) are unable to achieve fair share of the radio resources. In this context, Green communications employing cooperative and fair resource allocation techniques can help in reducing the carbon footprint and increasing Energy Efficiency (EE).
Most of the existing wireless systems use Orthogonal Frequency Division Multiple Access (OFDMA) to distribute radio resources among UEs. One of the existing RAT to use OFDMA is Long Term Evolution-Advanced (LTE-A), which has a similar structure to its predecessor LTE. In LTE, each Resource Block (RB) is a time frequency grid element. The basic RB structure contains 15 subcarriers of 12 KHz each and a 10 ms frame. Each frame is subdivided into 10 subframes of 1 ms and each subframe is further divided into 2 slots of 0.5 ms each. Each slot may contain 6 or 7 OFDM symbols depending on a normal or an extended cyclic prefix. The RB allocation can be changed after every Transmission Time Interval (TTI) based upon channel conditions or RB allocation algorithm. OFDMA offers flexibility of RBs Allocation to tailor user and network requirement, such as throughput, fairness, Energy EfficiencyEE, and Spectral Efficiency (SE). For example, in order to support higher peak data rates Carrier Aggregation (CA) is introduced to obtain wider bandwidth. Compared to LTE, CA in LTE-A can support maximum 5 adjacent/non-adjacent component carriers of maximum 20 MHz to achieve 100 MHz bandwidth.
In addition, LTE-A allows Layer 3 (L3) relays to be incorporated in the network that can decode and forward the data to a UE [3]. This cooperative communication addresses EE and throughput of the cell edge users by providing channel diversity. As the network can only accommodate finite relays, their placement is, therefore, crucial to manage the overall throughput. The RB allocation between direct link that is Base Station (BS)–UE and two hop link that is (BS)–Relay Node (RN)–UE can be done independently or in a shared manner. In [4], the authors have presented a thorough comparison of basic RB allocation schemes, which are Round Robin (RR), Proportional Fairness (PF), Maximum Throughput (MT), and Maximum Minimum (MM); they presented an alternating MT and PF based resource allocation scheme SAMM (abbreviated with Authors’ names) without considering any relay. The paper considered LTE system with a basic RB structure [5], 5 MHz bandwidth with fixed 10 users that are uniformly placed from the BS. These schemes have been compared in terms of sum throughput, individual user throughput and fairness based on JFI (Jains fairness index). The SAMM scheme provides a better tradeoff between throughput and fairness. Cell edge users show some throughput gains due to proportional fairness, however, this scheme fails to address EE. Authors in [6] considered EE for generic OFDMA based downlink system. They presented Bisection based Optimal Power Allocation (BOPA) algorithm for a given RB assignment. The BOPA works as an iterative approach based on water filling principle. This work uses equal power allocation among users for initial users’ rate calculation, whereas, a modified algorithm in [7] uses equal power per resource block.
In [8], the authors proposed a quality of service (QoS) aware optimization problem for relay-based multi-user cooperative OFDMA uplink system. The main goal is to find optimal solutions for relay selection, power allocation and subcarrier assignment that maximize the system throughput. Aiming to support and attain the green wireless LTE network, an energy-efficient resource allocation scheduler with QoS aware support for LTE network is proposed in [9]. The authors of [10] proposed a two-stage method to solve the inter-cell interference problem. In the first stage, the subcarrier allocation and time scheduling are jointly conducted with sequential users’ selection and without considering the interference. The power control optimization is left to the second stage, using a geometric programming method.
In [11], energy efficient resource block and power allocation optimal and low complexity suboptimal schemes are presented for OFDMA relay-assisted downlink. Authors use fractional programming to make the non-linear mixed integer problem to convex subtractive problem. In order to reduce the computational complexity of the optimal solution, they present two-stage RB allocation and transmission power control algorithms. The system model of this paper is similar to our model but they use relays (small eNB in that paper) with frequency reuse factor of one, and the users employ maximal ratio combining to maximize the received signal-to-noise ratio (SNR). In our case, we use multiplexing gain instead of the diversity gain at users’ end by exploiting the knowledge of their location in relay selection and users association algorithm. We have compared our proposed schemes with the low complexity energy-efficient resource block and power allocation (LERPA) algorithm 3 and 4 of [11].
Artificial intelligence techniques can be used in highly dynamic and stringent constraint Next-Generation networks. Since machine learning is a most promising technique of artificial intelligence, it can be directly/indirectly employed to achieve the goals of 5 G in cognitive radios, massive multiple-input multiple-output (MIMO), hybrid beamforming, femto/small cells, smart grid, wireless power transfer, device-to-device communications, non-orthogonal multiple access (NOMA) etc. [12]. This paper [12] gives an overview of the applications of machine learning in Next-Generation wireless networks. Specifically, supervised learning techniques are suitable for massive MIMO channel estimations and spectrum sensing, unsupervised learning could be helpful in users grouping and clustering; and reinforcement learning can be applied in resource allocation problems.
A detailed review on existing techniques and methods have been provided in [13]. For example, in [14], a cooperative Q-learning approach was applied as an efficient approach to solve the resource allocation problem in a multi-agent network. The quality of service QoS for each user and fairness in the network are taken into account and more than a four-fold increase in the number of supported small cells. The authors in [15], proposed a machine learning framework for resource allocation to determine the optimal or near-optimal solutions based on the learning of the most similar historical scenario.
In paper [16], the authors proposed an approximated solution to a wireless network capacity problem using flow allocation, link scheduling, and power control. The Support Vector Machine (SVM) was used to classify each link to be assigned maximal transmit power or be turned off, whereas, the deep belief networks (DBNs) computes an approximation of the optimal power allocation. Both learning approaches have been trained on offline computed optimal solutions. A novel resource allocation method using deep learning to squeeze the benefits of resource utilization was developed in [17]. It was reported that when the channel environment is changing fast, the deep learning method outperforms traditional resource optimization methods. The resource allocation is to be optimized by a convolutional neural network using channel information. A similar problem has been explored in [18] that use Upper Confidence Bound learning for Greedy Maximal Matching (GMM) when the channel statistics are unknown. Since the subchannel and power allocation problem is a non-convex combinatorial problem, the optimal solution of the subchannel and power allocation problem requires an exhaustive search over all possible combinations of subchannels and power levels. In order to train the deep neural network (DNN) for an optimal solution, Ref. [19] utilizes the genetic algorithm to get the training data for DNN. It shows that the prediction accuracy increases with the size of dataset and the number of hidden layers. A four-step reinforcement learning based intercell interference coordination (ICIC) scheme is presented in [20]. The users selection, resource allocation, power allocation, and retransmit packet identification are handled by reinforcement learning to reduce the intercell interference.
However, to the best of our knowledge no available literature discusses LTE-A with L3 relays for SE and EE consideration. In this work,
  • We present an energy efficient algorithm based on SAMM and BOPA for LTE-A system with a L3 relay. Performance evaluation in terms of throughput, fairness, power consumption, SE and EE is shown between two best performing schemes i.e., MT and SAMM considering equal power and BOPA.
  • Considering the practical deployment, where there may be more than one relay supporting the cell edge users, we devise a clustering strategy to obtain near optimal placement of L3 relays and users’ association.
  • In a multiple relay scenario, to optimize EE and reduce computational complexity of running algorithm every TTI, we present a two step machine learning process that uses both the SAMM and BOPA approach for resource and power allocation of the cell users. The proposed approach is compared to MT equal power, MT BOPA and SAMM equal power in terms of users’ throughput and EE.
A complete list of notations used in this paper is given in Table 1.
Rest of the paper is organized as follows: system model is described in Section 2, algorithms and performance for MT, SAMM and BOPA with single relay network are given in Section 3. Multiple relay users’ association and deployment with machine learning based power and RB allocation for SAMM is presented in Section 4. Complexity analysis is given in Section 5, followed by the conclusions in Section 6.

2. System Model

We consider a two-tier LTE-A system with a BS supported by L3 relays as shown in Figure 1. The relays are assumed to be In-band type 1b [3] and full duplex, placed in the center of BS to the most distant user. A total of K users and N RBs are considered with users placed at a uniform distance from BS. The total powers of BS and RN are denoted by P t o t a l B S and P t o t a l R N , respectively. The LTE-A system uses OFDMA transmission in the downlink. Let the system bandwidth is B with N number of RB, then, W = B N is the bandwidth of one RB. We express the channel gains g k , n D i r e c t _ l i n k and g k , n R e l a y _ l i n k for user k where k K = { 1 , K } on RB n where n N = { 1 , N } for BS and RN respectively. Practically, the channel gain depends upon various factors, including thermal noise at receiver, receiver noise figure, antenna gains, distance between transmitter and receiver, path loss exponent, log normal shadowing and fading. Therefore, for all the links, we can write
g k , n = ϱ ϕ 10 log 10 d k ζ k , n + 10 log 10 h k , n
In the above equation, ϱ (83.46 dB) is a constant depending upon thermal noise at receiver, receiver noise figure, and antenna gains, ϕ is path loss exponent, d k is the distance in Km from UE k to the BS/relay, ζ k , n (10.5 dB) is shadowing parameter modeled by a normally distributed random variable with standard deviation 8 dB, and h k , n corresponds to the Rayleigh fading channel coefficient of user k in subchannel n [21].
The throughput of user k is given by,
R k = 1 2 B N n = 1 N μ k , n log 2 ( 1 + S N R k , n ) , Access link users B N n = 1 N μ k , n log 2 ( 1 + S N R k , n ) , Direct link users
where the factor 1 / 2 in access link shows the two time-slots transmission from BS-RN and RN-UE, and μ k , n is the binary variable such that μ k , n = 1 when RB n is allocated to the user k, S N R k , n is the maximum average signal-to-noise ratio for user k between direct and relay links. Let S N R k , n D i r e c t _ l i n k be the signal-to-noise ratio for user k via Direct Link, and S N R k , n R e l a y _ l i n k be the signal-to-noise ratio for user k via Relay Link, then, the S N R k , n is given as
S N R k , n = max ( E { S N R k , n D i r e c t _ l i n k } , E { S N R k , n Re l a y _ l i n k } ) ,
S N R k , n D i r e c t _ l i n k = p k , n B S g k , n D i r e c t _ l i n k N 0 B N ,
S N R k , n Re l a y _ l i n k = min ( S N R k , n b a c k h a u l _ l i n k , S N R k , n a c c e s s _ l i n k ) ,
where, S N R k , n b a c k h a u l _ l i n k / a c c e s s _ l i n k is
S N R k , n b a c k h a u l _ l i n k / a c c e s s _ l i n k = p k , n B S / R N g k , n b a c k h a u l _ l i n k / a c c e s s _ l i n k N 0 B N
The Energy Efficiency EE in terms of b i t s / s / W a t t s can be expressed as
E E = k = 1 K n = 1 N μ k , n log 2 ( 1 + S N R k , n ) k = 1 K n = 1 N p k , n .
The EE optimization problem for the above scenario can be written as
maximize E E subject to k = 1 K n = 1 N p k , n P t o t a l p k , n 0 , k , n μ k , n = { 0 , 1 } , k , n k = 1 K μ k , n = 1 , n R 1 : R 2 : R K = α 1 : α 2 : α K
where α k is the proportional rate constraint [22]. We assume that channel state information (CSI) of all the users is known to the BS. Also, it is assumed that the RB allocation decision and assignment is done in less than channel coherence time so that CSI information can be used. This further puts constraints on the RB allocation algorithm complexity. The two-hop transmission to the RN users will be carried out in two TTI’s. In the first TTI, the BS will only send data to the RN users that are in close proximity of RN or have better RN-UE channel conditions than the direct link BS-UE. In the second TTI RN-UE data will be sent. BS will choose the path to the user (direct or via RN) with best channel coefficient in each TTI. The centralized scheduling minimizes the possibility of interference for In-band type of RNs. Frequency division duplexing ensures that the RN may handle backhaul data simultaneously with the access link data so that from the second TTI onwards backhaul BS-RN transmission is carried out simultaneously with the access link RN-UE transmission.
The LTE-A downlink is an OFDM based system which supports M-ary quadrature amplitude modulation (MQAM). We can use Equation (2) to calculate the throughput of user k on RB n for both direct and relay-link paths. The two paths provide channel diversity to increase the users and system level throughput. We use MT and SAMM criteria for RB allocation with equal power allocation to all RBs or BOPA as explained below.

3. Fairness-Aware Power and Resource Block Allocation with Single Relay LTE-A Network

There are several well-known resource allocation schemes for cellular systems, namely, round robin RR, maximize throughput MT, maximize the minimum throughput (max-min), and proportional fairness PF. An improved hybrid MT and PF scheme, SAMM is presented in [4]. We briefly summarize MT, PF, and SAMM, and then present our fairness-aware power and resource allocation algorithm.

3.1. Maximum Throughput

In a Maximize Throughput MT scheme, the aim is to maximize the sum throughput of the network. It assigns more RBs to the user which has better channel conditions on direct link or two hop link thereby adding more throughput to the system but its drawback is that users with the worst channel conditions are essentially ignored. The maximum throughput criterion in mathematical form is given as,
D k = arg max k ( R k )
where D k is RB allocation matrix and R k is rate matrix.

3.2. Proportional Fairness

The proportional fairness based resource allocation schemes are widely used in practical wireless communication systems. In this scheme, the system allocates the resource to a user who has the maximum PF metric. The PF criterion in mathematical form is given as,
D k = arg max k R k ( t ) R ¯ k ( t )
where R k ( t ) is the throughput of user k at scheduling time t, and R ¯ k ( t ) is the average user throughput (moving average) over a past window of length T w = 1 / α [23], as
R ¯ k ( t ) = α R k ( t 1 ) + ( 1 α ) R ¯ k ( t 1 ) ,

3.3. SAMM

In SAMM [4] PF and MT are run one after the other, i.e., in first TTI PF run for K users and in second TTI MT run for K 1 users ignoring the user with highest throughput in previous TTI. This results in maximizing fairness and throughput alternatively in each TTI.

3.4. BOPA Algorithm

Bisection based optimal power allocation BOPA Algorithm 1 allocates the power to the RBs assigned to a particular user. Given the RB allocation from MT or SAMM and throughput of each user at equal power allocated to all RBs we can calculate λ “rate parameter” as given below:
λ k = R 1 α 1 = R 2 α 2 = = R K α K
where R k is the rate of each user and α k is proportional rate constraint set for fairness [6]. Optimal power allocation is water filling operation and obtained for single user as
p ^ k , n = max 1 θ L ln 2 1 g k , n , 0
where θ L is Lagrangian multiplier and its value is chosen such that R k is satisfied. Hence, the user power can be expressed as P k ( λ α k | D k ) and the total transmit power P T ( λ ) can be rewritten as
P T ( λ ) = k K P k ( λ α k | D k )
EE can be given as user rate divided by power consumed to achieve that rate.
E E ( λ ) = λ k K α k P T ,
and total transmit power is also limited by
λ λ max .
According to [24] if transmit power P T ( λ ) is strictly convex in rate then E E ( λ ) is quasi-concave, global optimal solution proof is given in the appendix of paper [22]
f ( λ ) = P T ( λ ) λ ln 2 k K min n D k 1 + p ^ k , n g k , n g k , n α k
Bisection method is a simple and robust. Since the method brackets the root, it is guaranteed to converge. We apply BOPA on the RB allocation scheme SAMM, an alternating MT and PF scheme for the relay-assisted LTE-A for the optimal power allocation with the objective of maximizing the EE. In addition, we trained neural network with the dataset generated by the BOPA. Since power is a monotonically increasing function of the rate parameter λ , we apply bisection method on the following equation to find the root,
P ( λ ) = k n 2 λ α k N 1 g k , n P t o t a l = 0
Algorithm 1 BOPA Algorithm
1:
Require: p ^ k , n is the optimal power allocation matrix.
2:
Ensure: Prior RB allocation through any algorithm and given as D k .
3:
Getting all the λ then calculate λ m a x which gives the max energy Efficiency by substitution in Equation (6).
4:
Using λ m a x set user rate as α k λ m a x , do water filling using Equation (13) and calculate f( λ m a x ) based on Equation (17).
5:
If f ( λ m a x ) ≥ 0
6:
Return; p ^ k , n
7:
Else Go to Step 9;
8:
End if
9:
Set λ h i g h = λ m a x , λ l o w = 0, λ c u r r e n t = λ m a x /2
10:
Repeat: Set user rate according to α k λ m a x , do water filling using Equation (13) and calculate f( λ m a x ) based on Equation (17).
11:
If f ( λ c u r r e n t ) > 0
12:
Set λ l o w = λ c u r r e n t
13:
Else Set λ h i g h = λ c u r r e n t
14:
End if
15:
Set λ c u r r e n t = λ h i g h + λ l o w / 2
16:
Return p ^ k , n
17:
End if

3.5. Performance Evaluation

A single cell is considered for generating simulations results. The cell consists of a BS, RN and UEs equipped with Omni-directional antennas. The throughput, energy and spectral efficiency is averaged over 1000 TTIs, with the duration of a TTI being 0.5 ms. The channel involves Raleigh fading and distance based path loss as shown in Figure 1. BS is located in the center of the cell coverage and most distant user is 1 Km distant from BS with RN in between at 0.55 Km. RN are In-band full duplex relays and bit error rate (BER) considered for MQAM modulation is 10 3 . Table 2 below summarizes all simulation parameters used to derive results shown next.
Figure 2 shows the result of average throughput for MT and SAMM with equal power and BOPA based power allocation. It can be seen that SAMM curves remain on top of MT curves for most of the users due to inherent fairness which ensures all users get due share of RBs. However as evident from Figure 3 Sum throughput of MT is higher as compared to SAMM for overall averaged throughput of sum users due to channel exploitation of users with good channel conditions. This makes MT better than SAMM as BOPA has proportional rate constraint set for assigning user priorities.
Figure 4 shows energy efficiency per user in bits per seconds per watts. SAMM BOPA outperforms for initial users and remains considerably lower for rest of the users. Whereas MT BOPA compared to all other schemes performs better for every user of the system with consistency due to convergence of BOPA to maximize throughput and minimize energy.
Figure 5 shows fairness Index using Jains fairness Index [25] using below equation
F I = k = 1 K r k 2 K k = 1 K r 2 k ,
where r k can be throughput or EE. Figure 5 shows SAMM has better fairness in terms of throughput due to PF in its algorithm. Figure 6 depicts the system’s energy efficiency EE with and without power allocation. The BOPA-based power allocation algorithm allocates the available power to the RB to maximize the energy efficiency EE, therefore, both MT-BOPA and SAMM-BOPA outperforms their corresponding MT and SAMM schemes with equal power allocation.

4. Fairness-Aware Machine Learning Based Power and RB Allocation with Multiple Relays

In practical scenarios, multiple relays are deployed to facilitate the cell-edge users as shown in the Figure 7. The multiple relay deployment causes inter-relay interference. This interference can be minimized by the careful deployment of relays, transmit power control, and the scheduling of time/frequency resources. Though, L3 relays incur more processing delay as compared to the L1 and L2 relays but they provide robust transmission in the presence of interference [26]. Assume there are Q relays in a cell, such that relay q Q = { 1 , , Q } . The signal-to-interference-and-noise ratio (SINR) at UE k in direct link is given as
S I N R k , n D i r e c t _ l i n k = p k , n B S g k , n D i r e c t _ l i n k q Q p k , n q g k , n q + N 0 B N
where p k , n q is the transmit power of relay q assigned to its associated user k and g k , n q is the channel gain between relay q and the UE k. Similarly, the SINR at UE k in relay q link is given as
S I N R k , n q = p k , n q g k , n q q Q { q } p k , n q g k , n q + p k , n B S g k , n D i r e c t _ l i n k + N 0 B N
As seen from the above equation, the interference and fairness causes a significant increase in the computational cost when deploying multiple relays. Therefore, we present a machine learning based approach that utilizes relay deployment and users’ association data to develop RB allocation and Power allocation strategy that maximizes the sum EE. Once trained, the proposed approach can save cost of scheduling in every TTI. This is shown in Figure 8, the machine learning model takes the inputs: number of relays, relays’ coordinates, CSI, SNR, and total transmit power and produces the outputs: optimal relays’ coordinates with associated users, set of RBs assigned to each user k, and the optimal power allocation ( p k , n * ) to each user k in the RB n. Based on single relay performance, the RB allocation block is trained using SAMM and power allocation block is trained using BOPA. Since the relay deployment can significantly alter the RB and power allocation, a clustering approach is presented that determines relay positioning and corresponding users’ association based on a pre-defined metric.

4.1. Relays Deployment and Users Association

In this section, we present an autonomous unsupervised machine learning scheme that provides users association with optimally deployed relay nodes in the cell-edge area. Machine learning algorithms can broadly be divided into two main categories, namely supervised learning and unsupervised learning algorithms. The former class of algorithms learn by training on the input labeled examples, called training dataset, { ( x ( 1 ) , y ( 1 ) ) , ( x ( 2 ) , y ( 2 ) ) , ( x ( 3 ) , y ( 3 ) ) , , ( x ( m ) , y ( m ) ) } , where the i t h example ( x ( i ) , y ( i ) ) consists of the i t h instance of feature vector x ( i ) and the corresponding label y ( i ) . Given a labeled training dataset, these algorithms try to find the decision boundary that separates the positive and negative labeled examples by fitting a hypothesis to the input dataset. Unsupervised machine learning algorithms, on the other hand, are given an unlabeled input dataset. These algorithms are used for extracting information or features from the dataset. These features might be related, but not confined, to the underlying structures or patterns in the input data, relationships in data items, grouping/clustering of data items, etc. Discovered features are meant to provide a deeper insight into the input dataset that can subsequently be exploited for achieving specific goals. Clustering algorithms make an important part of unsupervised learning where the input examples are grouped into two or more separate clusters based on some features. The K-Means (KM) algorithm, is probably the most popular clustering algorithm. It is an iterative algorithm that starts with a set of initial centroids given to it as input. During each iteration, it performs the following two steps.
  • Assign Cluster: For every user, the algorithm computes the distance between the user and every centroid. The user is then associated to the cluster with the closest centroid. During this step, a user might change its association from one cluster to another one.
  • Recompute centroids: Once all users have been associated to their respective cluster, the new position of centroid for every cluster is then calculated.
Let us define the following notations to be used later in this section.
K = Total number of clusters being formed . x ( i ) = Location coordinates of user u ( i ) . In our case , x ( i ) I R 2 c ( i ) = Cluster to which the user u ( i ) is currently associated . μ k = Centroid of k t h cluster , μ k I R 2 μ c ( i ) = Centroid of the cluster to which the user u ( i ) is currently associated .
Now the cost function J can be defined as
J ( c ( 1 ) , c ( 2 ) , , c ( m ) , μ 1 , μ 2 , , μ K ) = 1 m i = 1 m | | x ( i ) u ( c i ) | | 2
with the following optimization objective function.
min c ( 1 ) , , , c ( m ) , μ 1 , , μ K J ( c ( 1 ) , c ( 2 ) , , c ( m ) , μ 1 , μ 2 , , μ K )
It may be pointed out that Equation (22) allows us to compare multiple clustering layouts based on their cost and select the one with the lowest cost.
In this section, we use the KM algorithm for optimal clustering of m users competing for resources in a particular cell. The clustering is performed based on their geographic location, thus our input dataset { u ( 1 ) , u ( 2 ) , u ( 3 ) , , u ( m ) } has m vectors u ( i ) , 1 i m , consisting of location coordinates, of ith user. For the sake of simplicity, we assume these users are deployed in a two dimensional area, i.e., a plane and so u ( i ) = ( x 1 ( i ) , x 2 ( i ) ) , i.e., an ordered pair of location coordinates. Our clustering algorithm is summarized in Algorithm 2.
The proposed algorithm takes the location coordinates of m users as input. It also takes two numbers m i n k and m a x k as additional inputs. The algorithm outputs the best number of clusters, k, such that m i n k k m a x k , and corresponding members of each cluster. It starts with k = m i n k and randomly selects k user locations as the initial centroids (line 6). It assigns the closest centroid to each user (line 8) and then computes new centroids by calculating the center/average location of all nodes in each cluster (line 11). So, in effect, the location of centroids keeps moving in successive iterations. It repeats the above two steps until the change in centroids’ positions is zero or negligible. We repeat the test m a x t times with a new set of randomly chosen initial centroids every time. During every test, the discovered centroids, corresponding centroid assignment to users, and the cost are saved (lines 14–16) for later comparison. After running the loop for m a x t times, we select and store the best k centroids resulting from the test with the lowest cost while discarding the remaining (lines 19–21). The same is repeated for the next value of k, i.e., k = k + 1 , until k > m a x k . At the end we have c n t = m a x k m a x k vectors μ k , one for each value of k, the corresponding assignment vector a k and cost c k . Finally, we choose the vector μ having the lowest cost and corresponding assignment vector a among c n t stored cases. That is the best number of clusters and corresponding centroids that the algorithm found. A snapshot of the relay deployment and users’s association algorithm output is shown in Figure 9.
Algorithm 2 Users association clustering algorithm
1:
c n t = 0
2:
for k = m i n k : m a x k do
3:
c n t = c n t + 1
4:
for t = 1 : m a x t do
5:
  repeat
6:
   Randomly choose initial k centroids μ 1 , μ 2 , μ 3 , , μ k
7:
   for i = 1 : m do
8:
     a ( i ) = j , 1 j k , such that μ j is the centroid closest to u ( i )
9:
   end for
10:
   for l = 1 : k do
11:
     μ l = mean of all users/points u ( i ) assigned to l t h centroid
12:
   end for
13:
  until converges
14:
   μ ( t ) = ( μ 1 , μ 2 , μ 3 , , μ k )
15:
   a ( t ) = ( a ( 1 ) , a ( 2 ) , a ( 3 ) , , a ( m ) )
16:
   c ( t ) = c o s t ( μ 1 , μ 2 , μ 3 , , μ k )
17:
end for
18:
i d x = arg m i n { c ( t ) , 1 t m a x t }
19:
μ k ( k ) = μ ( i d x ) , 1 i d x m a x t
20:
a k ( k ) = a ( i d x ) , 1 i d x m a x t
21:
c k ( k ) = c ( i d x ) , 1 i d x m a x t
22:
end for
23:
i n d e x = arg m i n { c k ( k ) , 1 k c n t }
24:
μ = μ k ( i n d e x ) , 1 i n d e x c n t
25:
a = a k ( i n d e x ) , 1 i n d e x c n t
26:
n = i n d e x

4.2. Resource Allocation by Multiclass Classification

The resource block allocation problem has multiple discrete outputs, i.e., the users, therefore, we use the multiclass classification to classify one out of K users. The multiclass classification is an extension of One-Vs-All classification. The input of the training network comprises of channel state information in terms of the SNR and the output consists of a particular user that maximizes the utility function (throughput for MT and PF metric for the proportional fairness). The training data is obtained from the implementation of SAMM algorithm of [4] as 25,000 K-dimensional samples of received SNR and the corresponding selected users. The dataset is partitioned into three parts, the training dataset, the validation dataset, and the test dataset. These are divided in 70%, 15%, and 15% ratio, respectively. The Matlab Neural Network Pattern Recognition Apps is used to train and deploy the neural network. It uses Scaled Conjugate Gradient algorithm [27] for training. Our application requires K = 10 neurons in input layer and 10 neurons in output layer. A hit and trial choice of eight neurons in hidden layer gave the best result. The neural network architecture is shown in Figure 10.
The neural network loss function is a generalization of the logistic regression’s loss function. In logistic regression classification problem, we try to find the weighted parameter θ , such that the mean square error between the predicted output and the actual output is minimized. This is called loss function (LF) or the cost function and is given by
L F ( θ ) = 1 m i = 1 m ( h θ ( x ( i ) ) y ( i ) ) 2
where the prediction or hypothesis function h θ ( x ) is a sigmoid function, i.e., h θ ( x ) = 1 1 + e θ T x . In the above equation, ( x ( i ) , y ( i ) ) is a training dataset with 1 , , m input-output pairs. However, loss function with sigmoid function leads to a non-convex function, therefore, a cross entropy based loss function is used to make it convex function as,
L F ( θ ) = 1 m i = 1 m [ y ( i ) log ( h θ ( x ( i ) ) ) + ( 1 y ( i ) ) log ( 1 h θ ( x ( i ) ) ) ] + λ R 2 m j = 1 n θ j 2
where the second summation is for the regularization of weight or bias units θ j and λ R is a regularization parameter.
In case of neural networks with multiclass classification, the prediction variable becomes K-dimension, h Θ ( x ) R K , therefore, the loss function is given as
L F ( Θ ) = 1 m i = 1 m k = 1 K [ y k ( i ) log ( h Θ ( x ( i ) ) ) k + ( 1 y ( i ) ) log ( 1 ( h Θ ( x ( i ) ) ) k ) ] + λ R 2 m l = 1 L 1 i = 1 s l j = 1 s l + 1 ( Θ j , i ( l ) ) 2
where L is the number of layers in neural network, s l is the number of neurons in layer l, and λ R = 5 × 10 4 is a regularization parameter to control the tradeoff between fitting the training dataset and keeping the parameter Θ small. The neural network is trained using the stochastic gradient descent algorithm. The gradient or partial derivative is calculated by the backpropagation algorithm and weights ( θ ) are updated. The amount at which the weights are updated is called learning rate. It our case, we set learning rate to 0.01 . Batch size is a matrix of input (or output) vectors applied to the network simultaneously to produce the update on network weights and biases. In our work, batch size of 128 (MATLAB default), 10 × 1 input vectors is used.
We use MATLAB 2019a App, Neur al Network Pattern Recognition (nprtool) which is a two-layer (one for hidden layer activation functions and other for output layer activation functions) feedforward network.
Lower the cross entropy higher the classification accuracy, zero cross entropy means no error. Figure 11 shows that cross entropy reaches 0.0078318 at iteration 136. Figure 12 shows variation in gradient coefficient with respect to number of epochs. The final value of gradient coefficient at epoch number 142 is 0.001787 which is approximately near to zero. Minimum the value of gradient coefficient better will be training and testing of networks. From the figure, it can be seen that the gradient value is decreasing with the increase in number of epochs. Large number of validation fails indicate the overtraining. In Figure 12 validation fails are the iterations when validation mean square error (MSE) increased its value. A lot of fails means overtraining. MATLAB automatically stops training after 6 fails in a row.
Figure 13 shows the error histogram of the trained neural network for the training, validation and testing parts. In this figure we can see that the data fitting errors are minimum and they are distributed within a closed range around zero. The confusion matrix Figure 14 visualizes the performance of supervised learning. The rows correspond to the predicted user (Output Class) and the columns correspond to the true user (Target Class). The diagonal cells correspond to observations that are correctly assigned the user-RB pairs. The off-diagonal cells correspond to incorrectly assigned user-RB pairs. The trained neural network provides 97.5 % classification accuracy. The Figure 15 represent the receiver operating characteristics (ROC) curves. The ROC curve plot shows the true positive rate versus the false positive rate as the threshold is varied. A perfect test would show points in the upper-left corner, with 100 % sensitivity and 100 % specificity [28]. In the RB allocation module, it worked very well.

4.3. Power Allocation through Two-Layer Feedforward Neural Network

In the power allocation problem, we have to map the numeric input dataset (SNR) to the numeric output dataset (allocated power) per user per RB. Therefore, we use neural network curve fitting technique. The training dataset is generated by the Algorithm 2 as input received SNR and output allocated transmit power. Given the resource blocks allocation set D k k K , the power allocation problem has been solved using two-layer feedforward neural network. The hidden layer neurons use sigmoid function as activation function and output neurons implement linear function as shown in Figure 16. We use Bayesian Regularization method to train the neural network. This method typically requires more training time but gives good results for difficult and noisy dataset. The Bayesian Regularization method uses Levenberg-Marquardt optimization to update the weight and bias values. It minimizes a combination of squared errors and weights, and then determines the correct combination for better generalization. In this method, the training does not stops after six consecutive validation (improve) fails and by default max_fail = inf. The training continues until an optimal combination of errors and weights is reached. More detail on the use of Bayesian regularization, along with Levenberg-Marquardt training, can be found in [29].
We use MATLAB 2019a App, Neural Net Fitting (nftool) which is a two-layer (one for hidden layer activation functions and other for output layer activation functions) feedforward network.
The mean-squared-error graph for the training and testing is shown in Figure 17. It shows that the MSE reaches to 0.087358 in 498 epochs. Our input/output samples to training network were channel gain/allocated power. Since, the total transmit power is a sum of linear functions of the channel gain, therefore, the neural network is got trained in a single epoch. An epoch is a full pass through the entire dataset and the calculation of new weights and biases. Figure 18 shows that the gradient coefficient reaches to 0.00076591 in 499 epochs. The lower value of gradient ensures the training and testing of the network. Other parameters such as Mu, Num Parameters, and Sum Squared Param are the stop criteria defined in Bayesian regularization backpropagation function ’trainbr’ [30]. Error histogram in Figure 19 visualizes the errors between target values and the predicted values after training a feedforward neural network. In this figure we can see that the data fitting errors are minimum and they are distributed within a closed range around zero. Around 88.1 % errors fall between 0.3 and 0.33 .

4.4. Performance Evaluation with Machine Learning Techniques

First, we apply the neural network for the RB and power allocation modules with a single relay. For the SAMM scheme in Figure 20 shows 30.25 % increase in the EE. This is because of the limitations of the BOPA method which sometimes returns no result, whereas, the neural network is trained on diverse dataset and always gives the output result. We also compare our proposed schemes with LERPA of [11]. LERPA uses max–min criteria for RB allocation and fractional programming based transmission power control. In case of LTE network with multiple relays as shown in Figure 7 or Figure 9, the users associated with relay q experience interference due to the neighboring relays q n e i g h . This interference decreases the users’ throughput as shown in Figure 21. However, the EE maximization based NN power allocation continues to dominate in the multiple relay scenario. Since the transmission is orthogonal between BS and RNs, only the relay’s associated users are affected by the other relays transmissions. The equal power MT throughput does not affect because almost all the users are associated with BS. This further reduces the required transmit power of the relay, hence a net increase in EE has been observed in Figure 22. Addition of multiple relays slightly affect the SAMM NN and SAMM equal power in positive and negative way, respectively. The PF component of the SAMM forces the association of low throughput users to increase the fairness. This association goes in positive way for the SAMM NN due to the EE based power allocation, but goes in negative way for the SAMM equal power because of no compensation of the interference power. The increased fairness of SAMM NN is evident from the Figure 21, where, even the farthest users 9 and 10 have higher throughput. It can be seen that in LERPA, closer users get lower throughput but fairly large throughput is given to the farther users. This is because it uses max-min criterion for the RB allocation, which assigns the RB to the users who have lowest received SNR.
Table 3 summarizes simulation results.
It can be seen that SAMM with BOPA and NN compete well in fairness with best EE. Tradeoff has to be done on system throughput. LERPA has better fairness performance but is less efficient in EE and system throughput, whereas, the hypothetical MT performs better in average system throughput. We say hypothetical because it only allocates the RB and power to the users with the highest SNR which can not be applicable on practical scenarios.

5. Complexity Analysis

The RB allocation scheme SAMM uses alternate MT and PF metrics to assign the N RBs to K users. MT assigns N 2 RBs to K users and PF assigns N 2 RBs to K 1 users in alternate TTI. Therefore, the computational complexity of SAMM is O N ( K 1 2 ) . The BOPA Algorithm 1, first requires λ m i n and λ m a x in line 4 using water-filling algorithm for which the worse-case complexity is O ( 2 N K ) . After that, BOPA uses binary search method to estimate the roots of Equation (17). In the worse case, with N p points in the search space, binary search requires log 2 ( N p ) iterations to find the roots of polynomial. In our case, N p = λ m a x λ m i n ϵ , where ϵ is the error tolerance. Therefore, the overall complexity of the Algorithm 1 is O ( 2 N K 2 log 2 ( N p ) ) . In case of the optimal exhaustive search ( K N ) RB allocation combining with the BOPA; the complexity is O ( 2 N K N + 2 log 2 ( N p ) ) , whereas, the complexity of SAMM-BOPA is O ( ( N K ) 2 ( 2 K + 1 ) log 2 ( N p ) ) .
The running-time complexity of the K-mean algorithm is O ( k m d i ) [31], where k is the number of clusters, m is the number of objects to be clustered, d is the dimension of objects, and i is the number of iterations. In our application of K-mean Algorithm 2, we use m i n k < k < m a x k and two-dimensional geographical location of the users. Therefore, the worse-case computational complexity is given as O ( m a x k K i ) .

6. Conclusions

In this paper, we have investigated the impact of using single and multiple L3 relays in terms of EE and throughput. For a single relay scenario, equal power and BOPA are used in conjunction with the SAMM and MT RB allocation algorithms. Simulation results show that SAMM BOPA has 26% power saving when compared with MT BOPA. Whereas, when comparing SAMM with equal power allocation to all RBs, our proposed scheme gives 77% increase in EE. For a multiple relay scenario, a clustering scheme is proposed that addresses relay placement and users’ association. This information acts as an input to a machine learning process (SAMM NN) that cognizes both the SAMM and BOPA approaches using One-Vs-All classification and feedforward neural networks, respectively. The SAMM NN approach when compared with the SAMM Equal Power, gives a 2.07 times increase in EE at the cost of 0.72 times decrease in throughput. A SAMM BOPA approach adopted in the case of single relay still provided the best tradeoff in terms of energy efficiency EE, throughput and fairness in the case of multiple relays.

Author Contributions

H.H., I.A., W.A. and R.A. contributed the key idea and defined the main system model. W.A. and M.M.A. assisted with the system model and the mathematical analysis. I.A. developed the machine learning framework. I.A., G.B. and H.K. developed the model for multiple relay scenario, relay selection and user association. I.A., W.A. and R.A. analysed all the results and added the relevant discussions. All authors contributed to the paper write up.

Funding

This research was supported in part by King Abdul Aziz City for Science and Technology Project under Grant PC-37-66. This research was also partially supported by European Union’s Horizon 2020 Research and Innovation Program under Grant 668995, European Union Regional Development Fund in the framework of the Tallinn University of Technology Development Program 2016-2022, and NATO-SPS funding grant agreement No. G5482.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
BERBit Error Rate
BOPABisection based Optimal Power Allocation
BSBase Station
CACarrier Aggregation
CoMPCoordinated Multipoint
CSIChannel State Information
EEEnergy Efficiency
JFIJains Fairness Index
L3Layer 3
LTE-ALong Term Evolution Advanced
MIMOMultiple-input multiple-output
MQAMM-ary Quadrature Amplitude Modulation
MTMaximum Throughput
OFDMOrthogonal Frequency Division Multiplexing
PFProportional Fairness
QoSQuality of service
RBResource Block
RNRelay Node
RRRound Robin
SAMMhybrid proportional fairness scheme
SINRsignal-to-interference-and-noise ratio
SNRsignal-to-noise ratio
TTITransmission Time Interval
UEUser Equipment

References

  1. Edler, T.; Lundberg, S. Energy efficiency enhancements in radio access networks. Ericsson Rev. 2004, 81, 42–51. [Google Scholar]
  2. Kumar, R.; Mieritz, L. Conceptualizing green IT and data center power and cooling issues (ID: G00150322), 7 September 2007. Retrieved from Gartner Database. Available online: https://www.gartner.com/en/documents/519717/conceptualizing-green-it-and-data-center-power-and-coolin (accessed on 20 July 2019).
  3. 3GPP; Evolved Universal Terrestrial Radio Access (E-UTRA); Study on mobile relay. Technical Report (TR) 36.836, 3rd Generation Partnership Project (3GPP). 2014. Version 12.0.0. Available online: https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx?specificationId=2427 (accessed on 21 May 2019).
  4. Al-Amri, A.; Al-Zahrani, S.; Al-Harthi, M.; Al-Qarni, M.; Ahmed, I. Hybrid frequency-time domain proportional fair resource allocation scheme for LTE downlink. In Proceedings of the 2012 18th IEEE International Conference on Networks (ICON), Singapore, 12–14 December 2012; pp. 286–290. [Google Scholar] [CrossRef]
  5. 3GPP; Long Term Evolution - Evolved Packet System RAN part (LTE). Release 8, 3rd Generation Partnership Project (3GPP). 2014. Version 0.3.3. Available online: https://www.3gpp.org/specifications/releases/72-release-8 (accessed on 21 May 2019).
  6. Ren, Z.; Chen, S.; Hu, B.; Ma, W. Energy-efficient resource allocation in downlink OFDM wireless systems with proportional rate constraints. IEEE Trans. Veh. Technol. 2014, 63, 2139–2150. [Google Scholar] [CrossRef]
  7. Hassan, H.; Ahmed, I.; Ahmad, R.; Ahmed, W.; Alam, M.M. Energy efficiency for bisection based power allocation with proportional fairness in relay-assisted LTE-A downlink system. In Proceedings of the Biennial Baltic Electronics Conference, Tallinn, Estonia, 8–10 October 2018; pp. 1–4. [Google Scholar] [CrossRef]
  8. Alam, M.S.; Mark, J.W.; Shen, X.S. Relay Selection and Resource Allocation for Multi-User Cooperative OFDMA Networks. IEEE Trans. Wirel. Commun. 2013, 12, 2193–2205. [Google Scholar] [CrossRef] [Green Version]
  9. Yusoff, R.; Dani Baba, M.; Ali, D. Energy-efficient resource allocation scheduler with QoS aware supports for green LTE network. In Proceedings of the 2015 6th IEEE Control and System Graduate Research Colloquium, Shah Alam, Malaysia, 10–11 August 2015; pp. 109–111. [Google Scholar] [CrossRef]
  10. Hua, Y.; Zhang, Q.; Niu, Z. Resource Allocation in Multi-cell OFDMA-based Relay Networks. In Proceedings of the 2010 Proceedings IEEE INFOCOM, San Diego, CA, USA, 14–19 March 2010; pp. 1–9. [Google Scholar] [CrossRef]
  11. Yang, K.; Martin, S.; Quadri, D.; Wu, J.; Feng, G. Energy-Efficient Downlink Resource Allocation in Heterogeneous OFDMA Networks. IEEE Trans. Veh. Technol. 2017, 66, 5086–5098. [Google Scholar] [CrossRef]
  12. Jiang, C.; Zhang, H.; Ren, Y.; Han, Z.; Chen, K.C.; Hanzo, L. Machine Learning Paradigms for Next-Generation Wireless Networks. IEEE Wirel. Commun. 2017, 24, 98–105. [Google Scholar] [CrossRef]
  13. Sun, Y.; Peng, M.; Zhou, Y.; Huang, Y.; Mao, S. Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues. Available online: https://arxiv.org/abs/1809.08707 (accessed on 2 May 2019).
  14. Amiri, R.; Mehrpouyan, H.; Fridman, L.; Mallik, R.K.; Nallanathan, A.; Matolak, D. A Machine Learning Approach for Power Allocation in HetNets Considering QoS. In Proceedings of the IEEE International Conference on Communications, Kansas City, MO, USA, 20–24 May 2018; pp. 1–7. [Google Scholar] [CrossRef]
  15. Wang, J.B.; Wang, J.; Wu, Y.; Wang, J.Y.; Zhu, H.; Lin, M.; Wang, J. A Machine Learning Framework for Resource Allocation Assisted by Cloud Computing. IEEE Netw. 2018, 32, 144–151. [Google Scholar] [CrossRef]
  16. Sun, C.; Cheng, Y.; Shi, H.; Liu, L.; Ma, R.; Cao, X. A Machine Learning-Based Algorithm for Joint Scheduling and Power Control in Wireless Networks. IEEE Internet Things J. 2018, 5, 4308–4318. [Google Scholar] [CrossRef]
  17. Huang, D.; Gao, Y.; Li, Y.; Hou, M.; Tang, W.; Cheng, S.; Li, X.; Sun, Y. Deep Learning Based Cooperative Resource Allocation in 5G Wireless Networks. Mob. Netw. Appl. 2018, 23, 1–8. [Google Scholar] [CrossRef]
  18. Stahlbuhk, T.; Shrader, B.; Modiano, E. Learning Algorithms for Scheduling in Wireless Networks with Unknown Channel Statistics. In Proceedings of the Eighteenth ACM International Symposium on Mobile Ad Hoc Networking and Computing, Mobihoc ’18, Los Angeles, CA, USA, 26–29 June 2018; ACM: New York, NY, USA, 2018; pp. 31–40. [Google Scholar] [CrossRef]
  19. Ahmed, K.I.; Tabassum, H.; Hossain, E. Deep Learning for Radio Resource Allocation in Multi-Cell Networks. IEEE Netw. 2019, 1–8. [Google Scholar] [CrossRef]
  20. Témoa, D.; Förster, A.; Kolyang; Yamigno, S.D. A reinforcement learning based intercell interference coordination in LTE networks. Future Internet 2019, 11, 19. [Google Scholar] [CrossRef]
  21. Ahmed, I.; Mohamed, A.; Shakeel, I. On the group proportional fairness of frequency domain resource allocation in L-SC-FDMA based LTE uplink. In Proceedings of the 2010 IEEE Globecom Workshops, GC’10, Miami, FL, USA, 6–10 December 2010. [Google Scholar] [CrossRef]
  22. Shen, Z.; Andrews, J.G.; Evans, B.L. Adaptive resource allocation in multiuser OFDM systems with proportional rate constraints. IEEE Trans. Wirel. Commun. 2005, 4, 2726–2737. [Google Scholar] [CrossRef] [Green Version]
  23. Escudero-Garzas, J.J.; Devillers, B.; Garcia-Armada, A. Fairness-Adaptive Goodput-Based Resource Allocation in OFDMA Downlink with ARQ. IEEE Trans. Veh. Technol. 2014, 63, 1178–1192. [Google Scholar] [CrossRef]
  24. Miao, G.; Himayat, N.; Li, G.Y. Energy-efficient link adaptation in frequency-selective channels. IEEE Trans. Commun. 2010, 58, 545–554. [Google Scholar] [CrossRef]
  25. Jain, R.; Chiu, D.M.; Hawe, W.R. A Quantitative Measure of Fairness and Discrimination for Resource Allocation in Shared Computer System; DEC Research Report TR-301; Eastern Research Laboratory, Digital Equipment Corporation: Hudson, MA, USA, 1984; Volume 38. [Google Scholar]
  26. Mikio, I.; Hideakii, T.; Satoshi, N. LTE-Advanced Relay Technology Self-backhauling. NTT DOCOMO Tech. J. 2011, 12, 29–36. [Google Scholar]
  27. Møller, M.F. A scaled conjugate gradient algorithm for fast supervised learning. Neural Netw. 1993, 6, 525–533. [Google Scholar] [CrossRef]
  28. Mathworks. Classify Patterns with a Shallow Neural Network—MATLAB & Simulink. Available online: https://www.mathworks.com/help/deeplearning/gs/classify-patterns-with-a-neural-network.html (accessed on 20 May 2019).
  29. Dan Foresee, F.; Hagan, M. Gauss-Newton approximation to Bayesian learning. In Proceedings of the International Conference on Neural Networks (ICNN’97), Lausanne, Switzerland, 8–10 October 1997; Volume 3, pp. 1930–1935. [Google Scholar] [CrossRef]
  30. Mathworks. Bayesian Regularization Backpropagation—MATLAB Trainbr. Available online: https://www.mathworks.com/help/deeplearning/ref/trainbr.html (accessed on 22 May 2019).
  31. Hartigan, J.A.; Wong, M.A. A K-Means Clustering Algorithm. Appl. Stat. 1979, 28, 100. [Google Scholar] [CrossRef]
Figure 1. Topology.
Figure 1. Topology.
Sensors 19 03461 g001
Figure 2. User vs. Throughput averaged over thousand times for SAMM and MT with equal power and BOPA.
Figure 2. User vs. Throughput averaged over thousand times for SAMM and MT with equal power and BOPA.
Sensors 19 03461 g002
Figure 3. Sum throughput of all users.
Figure 3. Sum throughput of all users.
Sensors 19 03461 g003
Figure 4. Users vs. Energy Efficiency (bits per second per watts) for all four schemes.
Figure 4. Users vs. Energy Efficiency (bits per second per watts) for all four schemes.
Sensors 19 03461 g004
Figure 5. Jains fairness Index for Throughput.
Figure 5. Jains fairness Index for Throughput.
Sensors 19 03461 g005
Figure 6. The system energy efficiency with and without BOPA based power allocation.
Figure 6. The system energy efficiency with and without BOPA based power allocation.
Sensors 19 03461 g006
Figure 7. LTE-A Network with Multiple L3 Relays.
Figure 7. LTE-A Network with Multiple L3 Relays.
Sensors 19 03461 g007
Figure 8. Block diagram of machine learning based resource and power allocation.
Figure 8. Block diagram of machine learning based resource and power allocation.
Sensors 19 03461 g008
Figure 9. A snapshot of the relay deployment and users’ association algorithm output in a 120 degree sector.
Figure 9. A snapshot of the relay deployment and users’ association algorithm output in a 120 degree sector.
Sensors 19 03461 g009
Figure 10. Neural network architecture for RB allocation, K = 10 .
Figure 10. Neural network architecture for RB allocation, K = 10 .
Sensors 19 03461 g010
Figure 11. The mean-squared-error for the training and testing of the RB allocation module.
Figure 11. The mean-squared-error for the training and testing of the RB allocation module.
Sensors 19 03461 g011
Figure 12. The neural network training states with gradient and validation fail statistics as a function of number of epochs.
Figure 12. The neural network training states with gradient and validation fail statistics as a function of number of epochs.
Sensors 19 03461 g012
Figure 13. The error histogram of the trained neural network for the training, validation and testing phases.
Figure 13. The error histogram of the trained neural network for the training, validation and testing phases.
Sensors 19 03461 g013
Figure 14. The confusion matrix for test dataset.
Figure 14. The confusion matrix for test dataset.
Sensors 19 03461 g014
Figure 15. Receiver Operating Characteristic (ROC curve).
Figure 15. Receiver Operating Characteristic (ROC curve).
Sensors 19 03461 g015
Figure 16. Neural network architecture for power allocation, K = 10 .
Figure 16. Neural network architecture for power allocation, K = 10 .
Sensors 19 03461 g016
Figure 17. The mean-squared-error for the training and testing of the power allocation module.
Figure 17. The mean-squared-error for the training and testing of the power allocation module.
Sensors 19 03461 g017
Figure 18. The neural network training states.
Figure 18. The neural network training states.
Sensors 19 03461 g018
Figure 19. The error histogram.
Figure 19. The error histogram.
Sensors 19 03461 g019
Figure 20. The system energy efficiency with neural network for SAMM which is trained on waterfilling based power allocation among users and BOPA based power allocation among subchannels in a single relay scenario.
Figure 20. The system energy efficiency with neural network for SAMM which is trained on waterfilling based power allocation among users and BOPA based power allocation among subchannels in a single relay scenario.
Sensors 19 03461 g020
Figure 21. The users’ throughput with neural network for SAMM along with LERPA of [11] in multiple relays scenario.
Figure 21. The users’ throughput with neural network for SAMM along with LERPA of [11] in multiple relays scenario.
Sensors 19 03461 g021
Figure 22. The system energy efficiency with neural network for SAMM which is trained on waterfilling based power allocation among users and BOPA based power allocation among subchannels along with LERPA of [11] in a multiple relays scenario.
Figure 22. The system energy efficiency with neural network for SAMM which is trained on waterfilling based power allocation among users and BOPA based power allocation among subchannels along with LERPA of [11] in a multiple relays scenario.
Sensors 19 03461 g022
Table 1. List of notations.
Table 1. List of notations.
NotationDefinition
μ k , n the RB assignment indicator
R k capacity of user k is given by the Shannon Capacity
S N R k , n the signal-to-noise ratio for user k on RB n
BSystem bandwidth
NNumber of RB
W = B N the RB bandwidth
P t o t a l R N , P t o t a l B S the total power at which RN and BS transmit
g k , n R e l a y _ l i n k , g k , n D i r e c t _ l i n k channel gains for user k on RB n for RN and BS
h k , n R e l a y _ l i n k , h k , n D i r e c t _ l i n k random channel coefficients for user k on RB n for RN and BS
S N R k , n D i r e c t _ l i n k signal-to-noise ratio for user k via Direct Link
S N R k , n R e l a y _ l i n k signal-to-noise ratio for user k via Relay Link
S I N R k , n D i r e c t _ l i n k signal-to-Interference-and-noise ratio for user k via Direct Link
α k proportional rate constraint for user k
λ k rate parameter for user k
D k allocated RB set for user k
R k rate matrix for user k
p ^ k , n optimal power allocation
P T total transmit power
θ Lagrangian multiplier
Table 2. Simulation Parameters.
Table 2. Simulation Parameters.
ParameterValue
Cell Radius1 Km
Noise Density ( σ )−171 dBm/Hz
No of users (K)10
Bandwidth (B)5 MHz
Number of resource blocks (RB) (N)25
No of subcarriers per RB12
Subcarrier bandwidth15 KHz
BS Transmitter Power46 dBm
Relay Power34 dBm
TTI duration0.5 ms
Relay distance from BS0.55 Km
Bit Error Rate (BER) 10 3
OFDM symbols per TTI7
Relay Type (In-band / Out-band Type 1 / Type 2)In-band with Type 1b (full duplex)
Table 3. Simulation Results.
Table 3. Simulation Results.
KPISAMM Equal PowerSAMM BOPASAMM NNMT Equal PowerMT BOPALERPA [11]
Energy Efficiency (Mbps/Watts)0.51280.54811.06300.66600.52020.8862
System average throughput (Mbps)2.14711.18451.10374.07784.57750.4137
Throughput fairness index0.31550.23370.22340.14530.13660.5797

Share and Cite

MDPI and ACS Style

Hassan, H.; Ahmed, I.; Ahmad, R.; Khammari, H.; Bhatti, G.; Ahmed, W.; Alam, M.M. A Machine Learning Approach to Achieving Energy Efficiency in Relay-Assisted LTE-A Downlink System. Sensors 2019, 19, 3461. https://doi.org/10.3390/s19163461

AMA Style

Hassan H, Ahmed I, Ahmad R, Khammari H, Bhatti G, Ahmed W, Alam MM. A Machine Learning Approach to Achieving Energy Efficiency in Relay-Assisted LTE-A Downlink System. Sensors. 2019; 19(16):3461. https://doi.org/10.3390/s19163461

Chicago/Turabian Style

Hassan, Hammad, Irfan Ahmed, Rizwan Ahmad, Hedi Khammari, Ghulam Bhatti, Waqas Ahmed, and Muhammad Mahtab Alam. 2019. "A Machine Learning Approach to Achieving Energy Efficiency in Relay-Assisted LTE-A Downlink System" Sensors 19, no. 16: 3461. https://doi.org/10.3390/s19163461

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop