Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

First- and second-line bevacizumab in ovarian cancer: A Belgian cost-utility analysis

  • Mattias Neyt ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Validation, Writing – original draft, Writing – review & editing

    mattias.neyt@kce.fgov.be

    Affiliation Belgian Health Care Knowledge Centre (KCE), Brussels, Belgium

  • Joan Vlayen,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Validation, Writing – original draft, Writing – review & editing

    Affiliation Belgian Health Care Knowledge Centre (KCE), Brussels, Belgium

  • Stephan Devriese,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Validation, Writing – original draft, Writing – review & editing

    Affiliation Belgian Health Care Knowledge Centre (KCE), Brussels, Belgium

  • Cécile Camberlin

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Belgian Health Care Knowledge Centre (KCE), Brussels, Belgium

Abstract

Background

Currently, in Belgium, bevacizumab is reimbursed for ovarian cancer patients, based on a contract between the Minister and the manufacturer including confidential agreements. This reimbursement will be re-evaluated in 2018.

Objective

To support the reimbursement reassessment by calculating the cost-effectiveness of bevacizumab: (1) in addition to first-line chemotherapy; (2) in the treatment of recurrent ovarian cancer (platinum-sensitive or platinum-resistant).

Methods

A health economic model has been developed for the Belgian situation according to the Belgian guidelines for economic evaluations. The lifetime Markov model was set up from the perspective of the health care payer (government and patient), including direct healthcare related costs. Results are expressed as the extra costs per quality-adjusted life year (QALY). Calculations were based on results of four international trials. Both probabilistic and one-way sensitivity analyses were performed.

Results

Incremental cost-effectiveness ratios (ICERs) of first-line bevacizumab are on average 158 000/QALY (GOG-0218 trial) and 443 000/QALY (ICON7 trial). The most favourable scenario is based on the stage IV subgroup of the GOG-0218 trial (€52 000/QALY). Since subgroup findings are often exploratory and require confirmatory studies, results of the economic evaluation based on this subgroup analysis should be considered with caution. For second-line bevacizumab, ICERs are on average €587 000/QALY (OCEANS trial) and €172 000/QALY (AURELIA trial). Sensitivity analysis shows that results are most sensitive to the price of bevacizumab.

Conclusion

From a health economic perspective, ICERs of bevacizumab are relatively high. The most favourable results are found for first-line treatment of stage IV ovarian cancer patients. Price reductions have a major impact on the estimated ICERs. It is recommended to take these findings into account when re-evaluating the reimbursement of bevacizumab in ovarian cancer.

Introduction

In Belgium, ovarian cancer is the eighth most frequent female cancer and the fifth in terms of female cancer mortality.[1] In 2014, 848 women were diagnosed with ovarian cancer. The mean age at diagnosis was 66.7 years. Around 72% of all ovarian cancers are diagnosed in an advanced stage when the tumour has already spread outside the pelvic area, to the retroperitoneal lymph nodes or beyond the peritoneum (stage III-IV).[2] The global relative five-year survival is 42.6%, but only 23.8% for stage IV.[3]

In advanced stage, cytoreductive surgery and chemotherapy are recommended according to the Belgian guidelines.[4] Standard first-line chemotherapy combination is carboplatin-paclitaxel.[4] For second-line chemotherapy, this combination may be re-used in platinum-sensitive patients, and carboplatin may also be switched to cisplatin. In case of allergy to platinum-based compounds, or non-response of the tumour to platinum-based chemotherapy (platinum-refractory tumour) or in case of relapse within 6 months after this kind of chemotherapy (platinum-resistant tumour), paclitaxel alone, pegylated liposomal doxorubicin hydrochloride (PLD), topotecan or gemcitabine represent possible options.[57]

For epithelial ovarian, fallopian or primitive peritoneal cancer, front-line treatment with bevacizumab in stage IIIB-IIIC-IV was authorized by the European Medicines Agency on 21 September 2011. This indication was extended to recurrent platinum-sensitive cancer on 20 September 2012 and to recurrent platinum-resistant cancer on 31 July 2014.[4] In Belgium, reimbursement for epithelial ovarian, fallopian or primitive peritoneal cancer (onwards we refer to this by using the term ‘ovarian cancer’) can be allowed in three types of indications: (1) first-line treatment of stage FIGO IV ovarian cancer (in combination with carboplatin and paclitaxel for a maximum of 6 treatment cycles and then in monotherapy until either a maximum of 15 months in total, disease progression or unacceptable toxicity); (2) first recurrence of ovarian cancer in patients sensitive to platin salts who have not yet been treated with bevacizumab or other VEGF inhibitors or other agents aiming at the VEGF receptor (in combination with carboplatin and gemcitabine during 6 to maximum 10 cycles and then in monotherapy until disease progression); or (3) second-line treatment of ovarian cancer in patients resistant to platin salts who have not received more than 2 chemotherapy lines and have not been treated with bevacizumab or other VEGF inhibitors or other agents aiming at the VEGF receptor (in combination with paclitaxel, topotecan or pegylated liposomal doxorubicin until disease progression or unacceptable toxicity).

The reimbursement terms were negotiated based on a contract (managed entry agreement) between the Minister of Social Affairs and Public Health and the manufacturer after the regular procedure did not result in the drug entry in the reimbursement schedule (article 81 of the Royal Decree of 21 December 2001).[8] In theory, both financial-based agreements, performance-linked coverage and coverage with evidence development agreements are possible. Unfortunately, the appendices of such a contract, including e.g. a possible request for further evidence or results of price negotiations, are confidential.[9] However, research evaluating the first 71 approved contracts in Belgium found that the compensation mechanisms used in Belgium mainly exist out of a percentage of the declared turnover (84.6%) or a fixed amount per package (10.8%).[9] On 1 March 2014, a first 3-year contract was concluded for the first-line treatment of stage IV and the treatment of first recurrence in platinum-sensitive patients. A second 3-year contract was concluded on 1 July 2015 for the treatment of platinum-resistant patients. When these contracts expire, the manufacturer receives up to one extra year to submit a new application for regular reimbursement or to close a new confidential contract.

In an independent health technology assessment (HTA),[3] the safety, clinical effectiveness and cost-effectiveness of bevacizumab were assessed in two situations: first, in addition to first-line chemotherapy for ovarian cancer; and second, in the treatment of recurrent ovarian cancer (platinum-sensitive or platinum-resistant). The results should support the negotiations when a new reimbursement request is submitted to the Belgian authorities. In this article, we provide details and results of the health economic evaluation to answer the following question: what is the cost-utility of bevacizumab in these indications? The Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist was used to optimise reporting of this evaluation (see S1 Table).[10]

Methods

Available RCTs

A systematic search of the clinical literature identified 5 relevant RCTs.[1115] Results of the GOG-0213 trial[13] were only published in a meeting abstract at the time of the search and insufficient details were available to include this trial in the model. A brief description of the eligible population in the selected studies and the bevacizumab treatment schedule are provided in Table 1. Our model reflects the same patient population as in the underlying trial. In our model, a cohort of 60 years old women was modelled.

thumbnail
Table 1. Eligible patient population and bevacizumab treatment schedules in 4 peer-reviewed RCTs.

https://doi.org/10.1371/journal.pone.0195134.t001

General information

In accordance with the Belgian guidelines for economic evaluations,[16] the analysis is performed from the health care payer’s perspective and includes direct health care costs. Payments out of the government’s health care budget as well as patients’ co-payments and co-insurances are included. No extension to a societal perspective was modelled since there is no evidence for relevant differences in employment rate, transport or other costs. An incremental impact seems negligible and thus would not influence the results.

Bevacizumab in addition to standard chemotherapy is compared to standard chemotherapy alone (GOG-0218 and ICON7 trial: carboplatin and paclitaxel; OCEANS: carboplatin and gemcitabine; AURELIA: liposomal doxorubicin or paclitaxel or topotecan). Since bevacizumab is given in addition to standard chemotherapy, the focus is on the extra costs for this drug and related administration costs.

Bevacizumab might have an impact on mortality. Therefore, adopting a lifetime time horizon is necessary to capture the full possible impact on all relevant incremental costs and effects. In alternative scenarios, this time horizon is limited to 10 and 5 years. Costs and effects are discounted on a 3-weekly basis in the Markov model. The choice for 3-weekly cycles is determined by the quality of life (QoL) scenarios (see further). Half-cycle correction is applied. According to the Belgian guidelines for economic evaluations,[16] a yearly discount rate of 3% and 1.5% for costs and effects, respectively, is applied (or 0.1702% and 0.0857% 3-weekly). Following these guidelines,[16] scenario analyses are performed with a 0%, 3% and 5% discount rate for both costs and effects.

QoL is of major importance to patients with cancer and can be influenced by both disease and treatments. Therefore, a cost-utility analysis (CUA) is performed. As requested by the national guidelines, results of the cost-effectiveness analysis (CEA) in which the years of life are not adjusted for QoL are also presented. Both incremental costs (IC), incremental effects (IE) in life years gained and QALYs gained, and incremental cost-effectiveness ratios (ICER) will be presented separately in the results section.

The results of all identified RCTs where modelled separately because outcome definitions and treatment schedules were not comparable (see also below). We relied on published information since we did not have access to individual patient data. In case of multiple publications about a specific study, the most up-to-date data were used.

Impact on mortality

Published Kaplan-Meier-curves (KM-curves) and hazard ratios for both overall survival (OS) and PFS were identified. OS and PFS were extracted from the KM-curves at fixed time points. This was done separately by two researchers using a different software (Datathief and R-Digitize). Because the difference between the two separate extractions was more than 1% in five cases of the 92 point estimates, a second check was performed and an incorrect measurement was excluded. Ultimately, the incremental difference between the control and bevacizumab group between the two researchers was always lower than 1%.

The mortality in the bevacizumab group was modelled through the hazard ratio (Table 2) (probability of death due to intervention = 1 − [probability of survival control therapy^(hazard ratio)]). Having no access to individual patient data, a constant hazard was assumed and the result was visually checked to see whether the modelled survival curves were in agreement with the extracted data from the published KM-curves. In the ICON7 high-risk group, this fit was not satisfying (the assumption of proportional hazards seems not justified) and both survival curves were therefore based on the extracted observations from the published KM-curves.

Impact on progression-free survival

For PFS, the same approach as for OS was initially applied. Pooling the results of the GOG-0218 and ICON7 trials was considered inappropriate since different definitions for progression-free survival (PFS) were used and a less intensive treatment schedule was used in the ICON7 trial (7.5mg/kg vs 15mg/kg).[14]

The visual check on the modelled survival curves also showed that it was preferable to work with the extracted information from the published KM-curves. If PFS lines crossed each other, we conservatively decided to coincide the curves. This assumption was always in the advantage of the bevacizumab group (since the KM-curves showed a somewhat worse PFS after some time for the bevacizumab group).

We provide supplementary material with a presentation of the modelled OS and PFS curves and the observed OS and PFS at fixed points in time extracted from the published KM-curves (S1 Fig). This provides the readers a view on the modelled lifetime horizon and also allows a visual validation of the models.

Extrapolation

KM-curves were published with a time window of 30 months (AURELIA) up to 60 months (ICON7) for OS and 12 months (AURELIA) up to 60 months (ICON7) for PFS. The observed differences in OS and PFS do not disappear at once after these follow-up periods. Therefore, extrapolation is appropriate. The 3-weekly probabilities during the last year in the trial are used to extrapolate. For the AURELIA trial, extrapolation was based on the last 6 months for both OS and PFS. This was also the case for PFS in the OCEANS trial. In the AURELIA trial, for overall survival, only 12 and 13 patients were at risk in the placebo and bevacizumab treatment arm, respectively, at 30 months follow-up. This might result in great uncertainty, which is then also used in the extrapolation phase. However, the 3-weekly mortality over a six-month period did not vary much when modelling up to 18, 24 or 30 months (between 4.41% and 4.46%). In the GOG, ICON7, and OCEANS trial, at least 56, 117, and 23 patients were at risk, respectively, at the last follow-up moment.

Three possible extrapolation scenarios are applied: 1) the 3-weekly risk of death remains constant over time (exponential survival); 2) the 3-weekly mortality risk increases with the absolute increase in mortality risk of the general Belgian female population of the same age; 3) the 3-weekly mortality risk increases with the relative increase in this mortality risk of the general Belgian female population of the same age. A first view on results showed that the first two options do not differ much. The third option results very probably in too pessimistic survival curves. Therefore, in the base case scenario, the first most conservative extrapolation approach was applied. The other two options were modelled in scenario analyses.

Impact on quality of life

The effect of first-line bevacizumab on QoL was reported in the GOG-0218 trial (measured with the FACT-O TOI instrument) and ICON7 trial (measured with the EORTC QLQ-C30 and QLQ-OV28 instruments). The results show an early (18 weeks) worsening in QoL when using bevacizumab. This negative effect disappeared in the long run in the GOG-0218 trial (60 weeks), but not in the ICON7 trial (54 weeks).[3] With second-line bevacizumab fewer patients reported abdominal/gastrointestinal symptoms (e.g. pain, ascites …) during chemotherapy, measured with EORTC QLQ-OV28. However, no differences in QoL were found when using other instruments (FOSI, EORTC QLQ-C30 and FACT-O-TOI).[3] Unfortunately, no utility values were reported (see Discussion).

In the NICE TA284 manufacturer submission (first-line bevacizumab),[19] QoL data from the ICON7 trial, measured with the generic EQ-5D questionnaire, were presented. The manufacturer’s submission did not present the utilities per treatment arm. In contrast, these values were aggregated for the PFS and progressed disease (PD) health states (see Table 3). As such, an improvement in QoL was modelled indirectly. In contrast with the available evidence, no decrease in QoL during the first cycles with bevacizumab was modelled. In case of the TA285 manufacturer submission (second-line bevacizumab), the values were retrieved from other studies and the manufacturer noticed that “the use of utility data from OVA-301 presented in TA222 should be interpreted with caution due to little overlap in the types of adverse event between OVA-301 and OCEANS.”[18]

In our base case scenario, we conservatively assume no decrease in QoL due to bevacizumab treatment and model an equal QoL through all cycles. We assume a utility value of 0.72 (as in PFS in TA285 and PD in TA284) with an uncertainty ranging from 0.62 to 0.82 (minimum and maximum values in the NICE submissions, modelled with a beta-distribution). In two scenario analyses, we model the input from the two manufacturer’s submissions to see in how far this influences our results (see Discussion) (Table 3).

Costs drug treatment

The incremental bevacizumab treatment costs were calculated by estimating the bevacizumab drug cost per cycle, the number of bevacizumab treatment cycles, and adding the extra costs for administration.

The bevacizumab drug cost per cycle is based on the Belgian sample of ovarian cancer patients diagnosed between 2008 and 2013 receiving bevacizumab, transmitted by the Belgian Cancer Registry. The year of costs is mainly 2014 since the majority of the patients (82.2%) received their first session in 2014. We remark that only patients with reimbursed bevacizumab treatment were selected for this estimate since, based on expert opinion, it is possible that a lower dose is administered when the treatment is not reimbursed. For Belgian ovarian cancer patients, the average bevacizumab cost was €3169 (SD: €977, based on 806 treatment cycles).[3] Applying the central limit theorem, a normal distribution is applied to include the average cost per bevacizumab treatment cycle. In Belgium, the price of a 100mg vial and 400mg vial is €333.67 and €1240.65, respectively. With a 15mg/kg body weight bevacizumab administration, the average cost of €3169 corresponds to an average population weight of about 64kg. The small difference in drug waste is taken into account when a different dose is administered, which resulted in an average bevacizumab treatment cost per cycle of €1676.2 (7.5mg/kg) and €2176.8 (10mg/kg) for the ICON7 and AURELIA model, respectively.

The bevacizumab cost per cycle is multiplied with the number of treatment cycles (total drug cost in Table 4). For the GOG-0218, ICON7 and OCEANS trial, the average number of treatment cycles are provided in the NICE manufacturer submissions (see Table 4). For the high-risk subgroup of the ICON7 trial no separate information on the mean treatment duration could be retrieved. In case of the AURELIA trial, only the median treatment duration was published: three cycles (range, one to 17 cycles) in the CT arm versus six cycles (range, one to 24 cycles) in the bevacizumab arm.[15] Treatment exposure was also published in a figure. With the data extraction software Datathief, an average treatment duration of 6.6 cycles of 4 weeks was extracted for the bevacizumab group and 4.2 cycles for the chemotherapy treatment arm. With a 4-weekly treatment cycle, this results in an average treatment duration of 26.2 and 16.7 weeks.[3] In case of the stage IV subgroup of the GOG-0218 trial, the manufacturer’s submission to the National Institute for Health and Disability Insurance (NIHDI) mentions an average treatment duration of 11.9 cycles (35.7 weeks), which is two cycles less than in the overall GOG-0218 population (Table 4). It is not clear whether the average chemotherapy treatment duration was also shorter. Conservatively in favour of bevacizumab treatment, the extra number of administrations was also reduced with two cycles.

thumbnail
Table 4. Mean treatment duration and bevacizumab treatment costs.

https://doi.org/10.1371/journal.pone.0195134.t004

Next to the drug cost, all extra costs on the day of administration are also taken into account. These costs are based on Belgian reimbursement data (from the InterMutualistic agency—IMA). When bevacizumab was administered without other chemotherapy, the average cost on the day of treatment was €339 (N = 423, SD: 204.25).[3] Applying the central limit theorem, this was modelled with a normal distribution. This extra cost on the day of administration was only counted for the extra treatment duration after chemotherapy (Table 4). To avoid complexity, these bevacizumab treatment costs are allocated to all patients at the first cycle of the model.

Since bevacizumab is an add-on therapy, no differences in chemotherapy costs were included for the bevacizumab treatment arm versus the chemotherapy arm.

Costs adverse events

A systematic review of the clinical literature[3] showed an increase in adverse events (AEs) in the bevacizumab treatment arm. We tried to include the AEs with a possible significant impact on costs. Four AEs were selected of which the absolute difference in incidence was relatively large or because the cost of treating the AE was potentially high: hypertension grade 2+, gastrointestinal (GI) perforation grade 2+, venous thromboembolism grade 3+ and arterial thromboembolism any grade. Hypertension was identified in the IMA data based on the reimbursement of the following pharmaceutical products: ATC C02 (antihypertensives), ATC C03 (diuretics), ATC C07 (beta blocking agents), ATC C08 (calcium channel blockers) or ATC C09 (agents acting on the renin-angiotensin system). Of bevacizumab patients, 92.1% had at least one of these products reimbursed following their diagnosis of ovarian cancer. However, only 4.6% of bevacizumab patients started with any of these products after their first bevacizumab session. For this reason and the fact that it is difficult to differentiate the hypertension grades in the available data, no cost was retained for hypertension. This is a conservative approach not disfavouring bevacizumab. Similarly, for thrombosis, the IMA data showed that 98.7% of bevacizumab patients had reimbursements for ATC B01A (antithrombotic agents) pharmaceutical products. All of these patients started with antithrombotic agents prior to their bevacizumab treatment. Therefore, no cost was retained for thrombosis. This is also a conservative approach not disfavouring bevacizumab.

Finally, only a cost for GI perforations was included. The number of events was modelled through a beta distribution (control group: 13/2095; bevacizumab group: 36/2109).[3] The cost for GI perforations was retrieved from the Technical cell (TCT) database that contains the administrative, inpatient and day-care hospital stays in Belgian general hospitals. In our sample of ovarian cancer patients (2008–2013), twelve inpatient hospital stays were identified with ID-9-CM codes 569.83 (perforation of the intestine) or 569.81 (fistula of intestine, excluding rectum and anus) as the principal diagnosis of the stay. The mean cost was €10 458 (SD: 7778).[3] Because the costs are based on a very small sample and costs for AEs are usually skewed to the right, they are represented by a gamma-distribution reflecting the same mean, standard deviation and minimum of our small sample (Gamma distribution: alpha: 1.23; beta: 7016.81; shift: 1836).

No differences in follow-up were modelled since it is not expected that these costs are very different between patients with and without bevacizumab treatment.

Uncertainty

Probabilistic sensitivity analyses (PSA) and one-way scenario analyses were performed in Microsoft Excel 2013, using @Risk software (Palisade Corporation). Scenario analyses included the following: population (GOG-0218, GOG-0218 stage IV, ICON7, ICON7 high-risk, OCEANS, and AURELIA); time horizon (lifetime (base case), 10 years, 5 years); discount rate (3% for costs and 1.5% for effects (base case), and 0%, 3%, or 5% for both costs and effects); extrapolation (constant mortality (base case), absolute or relative increase (see above)); QoL (equal QoL in both treatment arms (base case), values from manufacturer submissions TA284 or TA285). Because of the confidential price agreements, sensitivity analyses were also performed with price discounts between 0% and 100%.

Results are presented in table format (mean and 95% credibility intervals) and figures. Both cost-effectiveness planes, cost-effectiveness acceptability curves, and tornado graphs are provided.

Results

Table 5 gives an overview of the base case results for all modelled trials. In first line, the ICER is on average €158 000/QALY (GOG-0218) or €443 000/QALY (ICON7). In the most favourable subgroup analyses of these trials the ICERs improved to about €52 000/QALY (GOG-0218 stage IV subgroup) or €82 000/QALY (ICON7 high-risk subgroup). In second line, the average ICERs were €587 000/QALY (OCEANS) or €172 000/QALY (AURELIA).

thumbnail
Table 5. IC, IE & ICERs for the base case scenario (GOG-0218 (st.IV), ICON7 (high risk), OCEANS, and AURELIA).

https://doi.org/10.1371/journal.pone.0195134.t005

Fig 1 shows the cost-effectiveness plane, cost-effectiveness acceptability curve (CEAC), tornado graph, and price discount scenarios for the GOG-0218 trial. The high uncertainty around the treatment effect is reflected by the wide confidence interval around the incremental effects and part of the simulations situated in the fourth quadrant of the cost-effectiveness plane. The CEAC shows that up to a willingness-to-pay (WTP) of €50 000/QALY there is a 0% probability that bevacizumab is considered a cost-effective intervention. The tornado graph and price discount scenarios indicate the results are most sensitive to both the price of bevacizumab and the time horizon. The alternative QoL scenarios, based on the values from the manufacturer’s submissions to NICE, do not have a major impact on results. An 80% discount is needed to reach an average ICER of about €40 000/QALY or even 90% to reach an average ICER of about €25 000/QALY.

thumbnail
Fig 1. Results of the economic evaluation for the GOG-0218 trial.

https://doi.org/10.1371/journal.pone.0195134.g001

Similar information is available for all the other modelled trial results in supplementary material (S2 Fig).

Discussion

The calculated ICERs for bevacizumab treatment versus standard chemotherapy alone for ovarian cancer patients are relatively high in both the first- and second-line setting. The health gains seem to be relatively small in relation to the extra costs associated with bevacizumab treatment. In first line, the average ICERs are €158 000/QALY (GOG-0218) and €443 000/QALY (ICON7). Results are more positive in subgroups of these trials. The most optimistic outcomes are based on the stage IV subgroup of the GOG-0218 trial. In this subgroup analysis, average ICERs amount to €52 000/QALY in a rather optimistic scenario in which no decrease in QoL is assumed (see further), results are extrapolated to a lifetime time horizon with a constant mortality, and conservative assumptions for not including costs for specific side effects are made. In second line, the average ICERs based on the OCEANS and AURELIA trials amount to €587 000/QALY and €172 000/QALY, respectively.

A systematic review[3] of previously published economic evaluations identified 11 relevant publications.[1830] Two manufacturer submissions published by NICE[18 19] were included. The related Evidence Review Group (ERG) evaluations were also consulted.[20 21] These four publications were counted as two economic evaluations. For a detailed overview we refer to the full HTA report.[3] Economic evaluations referring to the GOG-0218[19, 25, 26, 29, 30] and/or ICON7[19, 22, 30] trials concluded that bevacizumab was not cost-effective. Of the four evaluations modelling the high-risk subgroup of the ICON7 trial,[22, 23, 27, 28] only two formulated rather positive conclusions by applying relatively high WTP values: Duong et al.[27] considered bevacizumab cost-effective in 56% of tested scenarios at a threshold of CAD100 000 (~€66 000) per QALY; and Chan et al.[23] considered an ICER of approximately $170 000 (~€152 000) per LYG near cost-effective based on current benchmarks. In the latter case, the authors referred to previous reimbursement decisions. However, it should be taken into account that it’s not clear in how far economic considerations were taken into account in previous policy decisions. As such, it is possible that inefficiencies from the past persist. In second line, based on the AURELIA trial, Chappell et al.[24] use a WTP threshold of $100 000 (~€89 000) per progression-free life-year saved to demonstrate bevacizumab is cost-effectiveness. However, PFS is not correlated with overall survival and extra costs per progression-free life-year are difficult to interpret. Even in the manufacturer’s submission file to NICE, the ICER of bevacizumab at the licensed dose was by far higher than NICE’s threshold of £20 000 to £30 000 (~€23 000 to ~€34 000) per QALY. In these files of the manufacturer, the probabilistic ICER was on average £145 000[19] (~€166 000) per QALY based on the GOG-0218 study (first line) and £222 000[18] (~€254 000) per QALY based on the OCEANS study (second line). Furthermore, in the latter case, as noticed by the Evidence Review Group, the manufacturer modelled a positive impact on OS based on the September 2010 results, which was not sustained in the March 2012 analysis of this trial. Finally, we remark that none of the previous published evaluations modelled the stage IV subgroup of the GOG-0218 trial.

No good QoL estimates for both the control arm and bevacizumab treatment arm were identified in the economic evaluations. A lot of different assumptions were made related to the impact of bevacizumab treatment on QoL, both in favour and disfavour of the drug. Some authors did not include QoL,[23, 25] others assumed an equal impact on QoL in both arms,[22, 24] also a decrease in QoL was assumed during bevacizumab treatment[26, 30] or due to more side effects, while most modelled an improvement thanks to an improved PFS.[18, 19, 2730] First, we remark that the clinical evidence in the first-line setting shows an early (18 weeks) worsening in QoL which might disappear in the long run (see above). If this is not taken into account, results can be considered being optimistic. Second, the ICON7 protocol incorporated the EQ-5D questionnaire to measure patients’ HRQoL.[31] Yet, the article entitled “Standard chemotherapy with or without bevacizumab in advanced ovarian cancer: quality-of-life outcomes from the International Collaboration on Ovarian Neoplasms (ICON7) phase 3 randomised trial”[32] did not publish these values. They were only published in the manufacturer’s submission to NICE. Unfortunately, results are not provided per treatment arm but only per health state (progression-free or progressed disease). As such, the size of the possible negative short-term impact on QoL is not clear. On the contrary, only a positive effect through longer PFS is modelled. Furthermore, as previously mentioned by the Evidence Review Group, the ICON7 trial “employed a lower dose of bevacizumab than in the NICE scope. Any AEs caused by the higher dose of bevacizumab as specified in the NICE scope would not be captured using the utility data from the ICON7 trial.”[20] Applying utility estimates from the ICON7 trial to the GOG-0218 trial might thus be too optimistic.

Another point of attention is the choice of the primary endpoint. Surrogate endpoints are frequently used in oncology clinical trials and also in this case the trials were powered to find a difference in PFS instead of OS. According to the EUnetHTA guidelines on clinical endpoints used for relative effectiveness assessment: “If progression-free survival (PFS) is used as an endpoint there should be sufficient independent evidence to demonstrate that this is associated with overall survival. … Overall survival is the gold standard for demonstrating clinical benefit and as such should be used where possible. … In the metastatic setting, data on PFS alone is insufficient and should be coupled with quality of life assessment and survival data, the maturity of which will be considered on the case by case basis.”[33] A systematic review has tried “to identify and evaluate trial-level meta-analyses of randomized clinical trials quantifying the association between a surrogate endpoint and overall survival in medical oncology. Trial-level correlations test whether treatments that improve the surrogate endpoint also improve the final endpoint and are widely considered the strongest evidence to validate a surrogate endpoint.”[34] Unfortunately, there was only a low correlation and it was concluded that the evidence supporting the use of surrogate endpoints in oncology was limited.[34] In the metastatic setting, the study identified 8 meta-analyses examining whether gains in PFS predict overall survival in metastatic breast cancer. Six reported a low correlation; 1 reported a medium correlation; and only 1 reported a strong correlation.[34] In a US study,[35] Kim and Prasad identified 54 approvals made during their search period, with 36 drugs (67%) approved on the basis of a surrogate endpoint. In 19 cases (53%), rate of response, measured by a reduction in tumour size or volume, was the primary measure of efficacy. In the other 17 cases (47%), PFS or disease-free survival was used. With a median follow-up of 4.4 years, 5 drugs were subsequently shown to improve overall survival in randomized studies, 18 drugs failed to improve overall survival as primary or secondary outcomes, and 13 drugs continue to have unknown survival effects.[35] Based on available evidence, the use of PFS is problematic and HTA researchers prefer to focus on the outcomes that really matter to the patient, being overall survival and overall QoL. In most countries, the preferred outcome measure in HTA are life-years and QALYs.[36] Also the Belgian guidelines recommend to use these outcomes instead of intermediary outcomes.[16] To measure the impact on QoL, the EUnetHTA guidelines on HRQoL recommend to include a generic utility instrument in complement to the disease-specific instruments.[37] This would contribute to the quality and reliability of economic evaluations.

Our economic evaluation is the first one to calculate the ICER for the stage IV subgroup of the GOG-0218 trial. One of the major reasons to do so is because this indication is currently reimbursed in Belgium through a confidential contract between the Minister and the manufacturer (managed entry agreement). The dangers of such analysis are well-known.[3] In 2016, regarding the subgroup analyses of the GOG-0218 trial, NICE considered that “the results from GOG-0218 (Randall 2013) represent an exploratory subgroup analysis of people with stage IV disease; confirmatory studies are required to strengthen Randall et al.’s conclusion that bevacizumab is more effective in people with stage IV disease. In addition, this analysis may not address the uncertainty in the survival benefit of bevacizumab. Considering these limitations, and the high incremental cost effectiveness ratio (ICER) for bevacizumab in the overall patient population, this exploratory subgroup analysis does not warrant a review of the guidance”.[38] Currently, at least three studies are ongoing in first line that include stage IV patients (NCT01462890 (BOOST); NCT01081262 (GOG-0241); and ISRCTN10356387 (ICON8B)). The results of these studies should be followed up.

Finally, evidence based medicine “integrates the best external evidence with individual clinical expertise and patients’ choice.”[39] Havrilesky et al.[40] studied patient preferences for seven attributes: mode of administration, visit frequency, peripheral neuropathy, nausea and vomiting, fatigue, abdominal discomfort and PFS. Ninety-five women with advanced or recurrent ovarian cancer participated. PFS was found to be the predominant driver of patient preferences for chemotherapy regimens, but overall survival and quality of life were not included in the experiment. Furthermore, patients’ choices indicated that they were willing to accept a shorter PFS to avoid severe side effects: a reduction of 6.7 months to reduce nausea and vomiting from severe to mild, 5.0 months to reduce neuropathy from severe to mild, and 3.7 months to reduce abdominal symptoms from severe to moderate.[40] In a larger study,[41] 1413 women with ovarian cancer participated in a survey about their preference regarding side effects and therapy endpoints. “Patients were willing to accept higher toxicity for a greater OS improvement, but not for attainment of PFS gains or stable disease. … Notable was the decreased acceptance of toxicity and daily impairment in the setting of recurrence.”[41] Although it is unfeasible to include the individual patient’s preference in general reimbursement decisions, it is still of absolute importance to consider this when choosing a specific treatment option.

In conclusion, the incremental cost-effectiveness ratio of bevacizumab for the treatment of ovarian cancer is relatively high, both in first- and second-line setting. In Belgium, bevacizumab is currently reimbursed in three indications through confidential contracts. New negotiations will probably be performed in the beginning of 2018. We recommend to take into account both the clinical and health-economic findings in the decision-making process on the (further) reimbursement of bevacizumab.

Supporting information

S2 Fig. Figures with results for other modelled RCTs.

https://doi.org/10.1371/journal.pone.0195134.s003

(DOCX)

References

  1. 1. Belgian Cancer Registry. Cancer burden in Belgium 2004–2013. Brussels: 2015.
  2. 2. Belgian Cancer Registry. Incidence Fact Sheet: Ovarian Cancer Belgium 2014. Brussels: BCR, 2016 25 October 2015. Report No.
  3. 3. Neyt M, Devriese S, Camberlin C, Vlayen J. Bevacizumab in the treatment of ovarian cancer. Brussels: Belgian Health Care Knowledge Centre (KCE), 2017 Contract No.: KCE Reports 285.
  4. 4. Vergote I, Vlayen J, Heus P, Hoogendam JP, Damen JAAG, Van de Wetering F, et al. Ovarian cancer: diagnosis, treatment and follow-up. Good Clinical Practice (GCP). Brussels: Belgian Health Care Knowledge Centre (KCE), 2016 29/04/2016. Report No.
  5. 5. Scottish Intercollegiate Guidelines Network. Management of epithelial ovarian cancer: A national clinical guideline. November 2013. Report No.: Contract No.: SIGN 135.
  6. 6. National Institute for Health and Care Excellence (NICE). Paclitaxel, pegylated liposomal doxorubicin hydrochloride and topotecan for second-line or subsequent treatment of advanced ovarian cancer. NICE technology appraisal guidance [TA91]. 2005.
  7. 7. Ludwig Boltzmann Institute for Health Technology Assessment. Bevacizumab (Avastin®) for platinum-resistant recurrent epithelial ovarian, fallopian tube or primary peritoneal cancer. Report. Vienna: Ludwig Boltzmann Institut fuer Health Technology Assessment (LBIHTA), 2014.
  8. 8. Arrêté royal du 21 décembre 2001 fixant les procédures, délais et conditions concernant l’intervention de l’assurance obligatoire soins de santé et indemnités dans le coût des spécialités pharmaceutiques, (29 December 2001).
  9. 9. Gerkens S, Neyt M, San Miguel L, Vinck I, Thiry N, Cleemput I. How to improve the Belgian process for Managed Entry Agreements? An analysis of the Belgian and international experience. Brussels: Belgian Health Care Knowledge Centre (KCE), 2017 Contract No.: KCE Reports 288.
  10. 10. Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. BMJ. 2013;346:f1049. pmid:23529982.
  11. 11. Aghajanian C, Blank SV, Goff BA, Judson PL, Teneriello MG, Husain A, et al. OCEANS: a randomized, double-blind, placebo-controlled phase III trial of chemotherapy with or without bevacizumab in patients with platinum-sensitive recurrent epithelial ovarian, primary peritoneal, or fallopian tube cancer. Journal of Clinical Oncology. 2012;30(17):2039–45. Epub 20120423. pmid:22529265
  12. 12. Burger RA, Brady MF, Bookman MA, Fleming GF, Monk BJ, Huang H, et al. Incorporation of bevacizumab in the primary treatment of ovarian cancer. New England Journal of Medicine. 2011;365(26):2473–83. pmid:22204724
  13. 13. Coleman R.L., Brady M.F., Herzog T.J., Sabbatini P., Armstrong D.K. WJL, Kim B.G., et al., editors. A Phase III Randomized Controlled Clinical Trial of Carboplatin and Paclitaxel Alone or in Combination with Bevacizumab Followed by Bevacizumab and Secondary Cytoreductive Surgery in Platinum-Sensitive, Recurrent Ovarian, Peritoneal Primary and Fallopian Tube Cancer (Gynecologic Oncology Group 213). Annual Meeting on Women’s Cancer; 2015; Chicago.
  14. 14. Oza AM, Cook AD, Pfisterer J, Embleton A, Ledermann JA, Pujade-Lauraine E, et al. Standard chemotherapy with or without bevacizumab for women with newly diagnosed ovarian cancer (ICON7): overall survival results of a phase 3 randomised trial. Lancet Oncology. 2015;16(8):928–36. Epub 20150623. pmid:26115797
  15. 15. Pujade-Lauraine E, Hilpert F, Weber B, Reuss A, Poveda A, Kristensen G, et al. Bevacizumab combined with chemotherapy for platinum-resistant recurrent ovarian cancer: The AURELIA open-label randomized phase III trial.[Erratum appears in J Clin Oncol. 2014 Dec 10;32(35):4025]. Journal of Clinical Oncology. 2014;32(13):1302–8. Epub 20140317. pmid:24637997
  16. 16. Cleemput I, Neyt M, Van de Sande S, Thiry N. Belgian guidelines for economic evaluations and budget impact analyses: second edition. Health Technology Assessment (HTA). Brussels: Belgian Health Care Knowledge Centre (KCE), 2012 D/2012/10.273/54 Contract No.: C.
  17. 17. Randall LM, Burger RA, Nguyen H, Kong G, Bookman MA, Fleming GF, et al. Outcome differences in patients with advanced epithelial ovarian, primary peritoneal and fallopian tube cancers treated with and without bevacizumab. Gynecologic Oncology. 2013;130:e1–e169: 80.
  18. 18. National Institute for Health and Care Excellence (NICE). Bevacizumab for the treatment of recurrent advanced ovarian cancer [TA285]. September 2012.
  19. 19. National Institute for Health and Care Excellence (NICE). Bevacizumab in combination with carboplatin and paclitaxel for the treatment of advanced ovarian cancer [TA284]. August 2012.
  20. 20. Cooper K, Pickett K, Frampton G, Copley V, Bryant J. Bevacizumab in combination with carboplatin and paclitaxel for the first-line treatment of ovarian cancer. A Single Technology Appraisal. SHTAC. Southampton Health Technology Assessments Centre, 2012.
  21. 21. Edwards S, Barton S TE, Nherera L, Hamilton V, Karner C, Trevor N. Bevacizumab for the treatment of recurrent advanced ovarian cancer: A Single Technology Appraisal. BMJ-TAG, London,. 2012.
  22. 22. Barnett JC, Alvarez Secord A, Cohn DE, Leath CA, Myers ER, Havrilesky LJ. Cost effectiveness of alternative strategies for incorporating bevacizumab into the primary treatment of ovarian cancer. Cancer. 2013;119(20):3653–61. 22013037271. pmid:23921967
  23. 23. Chan JK, Herzog TJ, Hu L, Monk BJ, Kiet T, Blansit K, et al. Bevacizumab in treatment of high-risk ovarian cancer: a cost-effectiveness analysis. Oncologist. 2014;19(5):523–7. 22014017183. pmid:24721817
  24. 24. Chappell NP, Miller CR, Fielden AD, Barnett JC. Is FDA-Approved Bevacizumab Cost-Effective When Included in the Treatment of Platinum-Resistant Recurrent Ovarian Cancer? J Oncol Pract. 2016;12(7):e775–83. http://dx.doi.org/10.1200/JOP.2015.010470. pmid:27246689.
  25. 25. Cohn DE, Kim KH, Resnick KE, O'Malley DM, Straughn JM. At what cost does a potential survival advantage of bevacizumab make sense for the primary treatment of ovarian cancer? A cost-effectiveness analysis. Journal of Clinical Oncology. 2011;29(10):1247–51. 22011000775 urger RA, Brady MF, Bookman MA, et al. Phase III trial of bevacizumab (BEV) in the primary treatment of advance epithelial ovarian cancer (EOC), primary peritoneal cancer (PPC), or fallopian tube cancer (FTC): a Gynecologic Oncology Group study. Journal of Clinical Oncology 2010; 28(5 Supplement):LBA1. pmid:21383297
  26. 26. Cohn DE, Barnett JC, Wenzel L, Monk BJ, Burger RA, Straughn JM Jr., et al. A cost-utility analysis of NRG Oncology/Gynecologic Oncology Group Protocol 218: incorporating prospectively collected quality-of-life scores in an economic model of treatment of ovarian cancer. Gynecologic Oncology. 2015;136(2):293–9. http://dx.doi.org/10.1016/j.ygyno.2014.10.020. pmid:25449568.
  27. 27. Duong M, Wright E, Yin L, Martin-Nunez I, Ghatage P, Fung-Kee-Fung M. The cost-effectiveness of bevacizumab for the treatment of advanced ovarian cancer in Canada. Curr Oncol. 2016;23(5):e461–e7. pmid:27803606.
  28. 28. Hinde S, Epstein D, Cook A, Embleton A, Perren T, Sculpher M. The Cost-Effectiveness of Bevacizumab in Advanced Ovarian Cancer Using Evidence from the ICON7 Trial. Value in Health. 2016;19(4):431–9. http://dx.doi.org/10.1016/j.jval.2016.01.013. pmid:27325335.
  29. 29. Lesnock JL, Farris C, Krivak TC, Smith KJ, Markman M. Consolidation paclitaxel is more cost-effective than bevacizumab following upfront treatment of advanced epithelial ovarian cancer. Gynecologic Oncology. 2011;122(3):473–8. 22011001488. pmid:21665250
  30. 30. Mehta DA, Hay JW. Cost-effectiveness of adding bevacizumab to first line therapy for patients with advanced ovarian cancer. Gynecologic Oncology. 2014;132(3):677–83. 22014007143. pmid:24463160
  31. 31. Protocol. ICON7—A randomised, two-arm, multi-centre Gynaecologic Cancer InterGroup trial of adding bevacizumab to standard chemotherapy (carboplatin and paclitaxel) in patients with epithelial ovarian cancer. Version 4.0; EUDRACT: 2005–003929–22; ISRCTN: 91273375. 15th October 2009.
  32. 32. Stark D, Nankivell M, Pujade-Lauraine E, Kristensen G, Elit L, Stockler M, et al. Standard chemotherapy with or without bevacizumab in advanced ovarian cancer: quality-of-life outcomes from the International Collaboration on Ovarian Neoplasms (ICON7) phase 3 randomised trial. Lancet Oncology. 2013;14(3):236–43. Epub 20130118. pmid:23333117
  33. 33. European network for Health Technology Assessment (EUnetHTA). Endpoints used for Relative Effectiveness Assessment: Clinical Endpoints. 2015.
  34. 34. Prasad V, Kim C, Burotto M, Vandross A. The Strength of Association Between Surrogate End Points and Survival in Oncology: A Systematic Review of Trial-Level Meta-analyses. JAMA Intern Med. 2015;175(8):1389–98. pmid:26098871.
  35. 35. Kim C, Prasad V. Cancer Drugs Approved on the Basis of a Surrogate End Point and Subsequent Overall Survival: An Analysis of 5 Years of US Food and Drug Administration Approvals. JAMA Intern Med. 2015;175(12):1992–4. pmid:26502403.
  36. 36. European network for Health Technology Assessment (EUnetHTA). Methods for health economic evaluations—A guideline based on current practices in Europe. May 2015.
  37. 37. European network for Health Technology Assessment (EUnetHTA). Endpoints used for relative effectiveness assessment of pharmaceuticals—health-related quality of life and utility measures. February 2013.
  38. 38. National Institute for Health and Care Excellence. GUIDANCE EXECUTIVE (GE)—Review of TA284; Bevacizumab in combination with paclitaxel and carboplatin for the first-line treatment of advanced and/or metastatic ovarian cancer, and TA285; Bevacizumab in combination with gemcitabine and carboplatin for treating the first recurrence of platinum-sensitive advanced ovarian cancer. 2016.
  39. 39. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. BMJ. 1996;312(7023):71–2. Epub 1996/01/13. pmid:8555924.
  40. 40. Havrilesky LJ, Alvarez Secord A, Ehrisman JA, Berchuck A, Valea FA, Lee PS, et al. Patient preferences in advanced or recurrent ovarian cancer. Cancer. 2014;120(23):3651–9. pmid:25091693.
  41. 41. Minion LE, Coleman RL, Alvarez RD, Herzog TJ. Endpoints in clinical trials: What do patients consider important? A survey of the Ovarian Cancer National Alliance. Gynecologic Oncology. 2016;140(2):193–8. pmid:26631607.