0.2
2022CiteScore
 
37th percentile
Powered by  Scopus

Do we need real world data? Polish ISPOR Chapter Therapeutic Programs, Pharmaceutical Care and Pharmaceutical Law Section (TPPCPL) initial discussion

  • Copyright
    © 2014 PRO MEDICINA Foundation, Published by PRO MEDICINA Foundation
    User License
    The journal provides published content under the terms of the Creative Commons 4.0 Attribution-International Non-Commercial Use (CC BY-NC 4.0) license.

Authors

Name Affiliation
Mariola Drozd
Department of Applied Pharmacy, Medical University of Lublin, Poland
Monika Szkultecka-Dębek
Roche Polska Sp z o.o.
contributed: 2015-04-15
final review: 2015-04-15
published: 2014-12-31
Corresponding author:
Abstract

Objective: to discuss potential areas for use and sources of real world data in relation to medical treatment.

Methods: we performed Pub-Med and an internet based search in literature for definitions, sources and examples of real world data use.

Results: we identified 13 publications fitting our search criteria and we found that there are not many full publications related to real world data even if they can provide significant additional information regarding patient related outcomes, resources use, costs and the effect of therapies in a non-controlled environment and on broader populations than those from randomized clinical trials.

Conclusion: Real world data can provide additional information in relation to medical treatments however there is a need to focus attention on methodology of data collection, data quality, potential sources of data and ensure proper legal environment for data collection. Unfortunately, despite large number of publications identified in PubMed database, there are only few available in a form of full text papers, the majority of publications are only abstracts from scientific conferences. In the future in order to share RWD experience it will be of benefit to encourage authors to work on full publications and not to limit their work only to abstracts.



Keywords: real world data, registries, RWD

Introduction

Nowadays it is not enough to obtain information related to new treatment option only from the randomized clinical trials. We can observe that the RCTs considered till now as the golden standard of evidence are not able to provide us with all the information we would like to have. Information about what the effectiveness of the new therapeutic treatment is, how it works on daily basis, if it is safe, what the real resources are used when treating patients with the new option. That and much more questions are related to real life data.

Objective: Our aim at the Therapeutic Programs, Pharmaceutical Care and Pharmaceutical Law Section (TPPCPL) task force was to investigate what is understood as real world data and what are the potential areas for use of real world data in relation to introduction of new therapeutic options to the market. This is only an initial approach to potential further discussion to be continued by the task force.

Methods: The analysis we performed was based on a literature search using the Internet. The Medline-PubMed databases have been reviewed. The initial search was focused on “real world data” term. Second search was restricted to real world data and the use of definition in the performed studies. Search strategy was based on terms: “real world data” [All Fields] AND "definition"[All Fields]. Reviewing all obtained publications from the performed search we analyzed in detail the publications from the period between years 2011-2014 and species – humans.

Results: We identified 7208 publications, however only 13 were meeting our search criteria (diagram 1). After analysis of the full texts we found 1 publication was the ISPOR Task Force report [1], 4 publications related to outcomes, disease or therapies [2,3,4,5], 1 was a quality of life study [6], and 1 was a methodology discussion paper in relation to statistical testing for clinical effectiveness studies [7]. Additionally, we realized that there are many abstract publications available. Based on those publications we found that real world data can provide additional valuable information to clinicians, payers, industry, patients and society on how the product or technology works in real life setting, in a non-controlled environment, outside randomized clinical trials; what the health related outcomes are, resources used for a disease treatment or the costs.

An important initiative identified was the one by ISPOR organization who has created a task force to discuss using RWD for coverage and payment decisions [1]. The task force defined RWD as data that is collected outside conventional Randomized Controlled Trials (RCTs). The real world data are raw data, non-informative while real world evidence is information that is organized to inform a conclusion or a judgment, it is typically undertaken according to a research plan and it is shaped to be informative, i.e. to clinical or payer decisions.

During their work the task force members looked at RWD sources and type of outcomes (economic, PROs and clinical outcomes).

They concluded that “Real world data are essential for sound coverage, payment, and reimbursement decisions. The types and applications of such are varied, and context matters greatly in determining the value of a particular type of evidence in any circumstance. Different study designs can provide useful information in different situations. Randomized controlled trials remain the gold standard for demonstrating clinical efficacy in restricted trial setting, but other designs—such as observational registries, claims databases, and practical clinical trials—can contribute to the evidence base needed for coverage and payment decisions.” [1].

E.T. Masters in her publication about outcomes assessment and RWD related to pain mentions the different sources of real world data we have such as supplements to RCTs, large simple trials, patient registries, administrative claim databases, surveys, electronic health records [2].

Depending on the further data use and the sources for data which are available in each of the countries in the literature we can find examples of different approach to real world research and analysis. Some countries have disease registries in place and due to ongoing collection of real world information they are able to analyze the data about the disease and its treatment.

An interesting finding in our search was that despite a large number of records identified there are not that many real world data full text publications related to pharmaceutical products, registries or methodologies. Based on the final number of 13 full publications only 3 were related to collection of real world data using data from registries or electronic databases either in a prospective or retrospective way. [3,4,5].

Based on the few identified publications and the large number of abstracts we can see cases when the real data can provide additional information on the effect of treatment, also on real length of the treatment [8] or how utilizing real world data can provide input into medical costs or health care cost reduction [9,10,11,12], and also examples showing how RWD can be useful to provide more understanding about disease burden, epidemiology or resources used in relation to the disease treatment [13]. RWD are not only valuable to learn more about treatment but can also provide significant input into prevention, information about the management of diseases like e.g. management of cardiovascular risk in primary prevention [14].

Important are the discussions about methodology for data collection, quality of the data and usage for decision-making. A discussion about methods how to enable implementation of RWD into network meta-analyses supporting regulatory or reimbursement decisions was published by D. Jenkins, M. Czachorowski, S. Bujkiewicz et al. [15]. Related to methods and quality of data is the issue of representative sample. E. Gemmen, L. Parmenter and A.B. Mendelsohn look at the most effective approaches to achieve data from real world being representative of the target population [16].

In Brazil there was a research on potential usage of the existing database in health economic analyses with a study focused on acute myocardial infarction [17]. Another use of RWD from databases information can be budget impact calculations [18].

Long-term data collection within a large database can be basis for benefit and patient reported outcomes assessment. Such example is the German registry for psoriasis showing burden of the disease at the time when patient enter into the registry and the quality of care with assessment of the impact on health outcomes [19]. 

S.J. Rizvi with co-workers indicated that real-world data can confirm the high prevalence of treatment-resistant depression (TRD) and impact the burden of illness associated with TRD in primary care settings in Canada [20].

E. Katodritou with co-workers published their study concluding that RWD are not comparable with the results of the RCTs. However, they may be used to confirm the data of the RCTs and, thus, facilitate the incorporation of certain therapies in standard clinical management [21].

Research in the real world is necessary because of the variety of factors that may play an important role influencing the effectiveness in real life. Factors such as comorbidities, concomitant treatments, adherence, access to care, the strength of the physician-caregiver communication and socio-economic factors among others can modulate the treatment results. Observational studies databases can provide a sufficient level of evidence to support the creation of guidelines i.e., clinical or provide significant information for the decision-making process [22].

Conclusion: Real world data can provide additional information in relation to medical treatments however there is a need to focus attention on methodology of data collection, data quality, potential sources of data and ensure proper legal environment for data collection. Unfortunately, despite large number of publications identified in PubMed database, there are only few available in a form of full text papers, the majority of publications are only abstracts from scientific conferences. In the future in order to share RWD experience it will be of benefit to encourage authors to work on full publications and not to limit their work only to abstracts.

Diagram 1. Search strategies in the library database – PubMed

References
  1. Garrison L. et al. Using RWD for coverage and payment decisions: ISPOR RWD Task Force Report, Value in Health,  2007, 10, 5
  2. Masters E. T. et al. Real World Data for Use in the Real World: The Pain Paradigm, ISPOR Connections, vol. 19, Nr2, March/April 2013
  3. Zhang F. et al. Real-world use of the second-generation cobalt-chromium sirolimus-eluting stents: 12-month results from the prospective multicentre FOCUS registry. FOCUS registry investigators. EuroIntervention. 2012 Dec 20; 8(8):896-903. doi: 10.4244/EIJV8I8A138
  4. Xu B. et al. Comparison of long-term clinical outcome after successful implantation of FIREBIRD and CYPHER sirolimus-eluting stents in daily clinical practice: analysis of a large single-center registry.; Chin Med J (Engl). 2011 Apr; 124(7): 990-6
  5. Rosenman M.B. et al. Perceived or actual barriers to warfarin use in atrial fibrillation based on electronic medical records. Am J Ther. 2012 Sep; 19(5): 330-7; doi: 10.1097/MJT.0b013e3182546840
  6. Zimmerman M. et al. Determining remission from depression on two self-report symptom scales: a comparison of the Quick Inventory of Depressive Symptomatology and the Clinically Useful Depression Outcome Scale. Comprehensive Psychiatry 2013, 53, 7, p. 901-10488.  ​Available from: (http://dx.doi.org/10.1016/j.comppsych.2012.03.001)
  7. Wise E. A. Statistical significance testing and clinical effectiveness studies. Psychotherapy (Chic). 2011 Sep; 48(3): 225-8; discussion 234-6; doi: 10.1037/a0022701
  8. Leproust S. et al. PDB18 - Treatment Maintenance Duration of Dual Therapy with Metformin and Sitagliptin in Type 2 Diabetes – Real-World Data From Odyssee Study, Value in Health, 2014, 17, 7, p. A334-A335; ​Available from: http://dx.doi.org/10.1016/j.jval.2014.08.640. (http://www.sciencedirect.com/science/article/pii/S1098301514025704)
  9. Iwasaki K. et al. PDB20 - Example Of Analysis Utilizing Real World Data: Medical Cost Reduction By Advising Untreated-Diabetes Patients To Visit Doctors, Value in Health, 2014, 17, 7, p. A744; ​Available from: http://dx.doi.org/10.1016/j.jval.2014.08.158; (http://www.sciencedirect.com/science/article/pii/S1098301514020889)
  10. Iwasaki K. et al. PCV25 - Example of Analysis Utilizing Real World Data: Medical Cost Reduction by Advising Untreated-Hypertension Patients to Visit Doctors, Value in Health, 2014, 17,7,p. A760; ​Available from: http://dx.doi.org/10.1016/j.jval.2014.08.252;(http://www.sciencedirect.com/science/article/pii/S1098301514021822)
  11. Iwasaki K. et al. DU2 - Example of Analysis Utilizing Real World Data: Medical Cost Reduction of Combination Drugs, Value in Health, 2014, 17, 7, p. A720-A721; ​Available from: http://dx.doi.org/10.1016/j.jval.2014.08.016; (http://www.sciencedirect.com/science/article/pii/S1098301514019469)
  12. Baser O. et al. PMS3 - Impact of Comorbidity Burden on Real-World Health Care Costs of Rheumatoid Arthritis Patients in Turkey, Value in Health, 2013, 16, 7, p. A555; ​Available from: http://dx.doi.org/10.1016/j.jval.2013.08.1446;  (http://www.sciencedirect.com/science/article/pii/S1098301513033512)
  13. De Rosa M. et al. PHP36 - Monitoring Health Processes in the Real World: An Italian Population Database Experience, Value in Health, 2013, 16, 7, p. A677; ​Available from: http://dx.doi.org/10.1016/j.jval.2013.08.1983;  (http://www.sciencedirect.com/science/article/pii/S1098301513038953)
  14. Danchin N. et al. Prise en charge cardiovasculaire en prévention primaire : le monde réel, Archives of Cardiovascular Diseases Supplements, 2012, 4, 4, p. 279-283; ​Available from: http://dx.doi.org/10.1016/S1878-6480(12)70843-1; (http://www.sciencedirect.com/science/article/pii/S1878648012708431)
  15. Jenkins D. et al. PRM188 - Evaluation of Methods for the Inclusion of Real World Evidence in Network Meta-Analysis – A Case Study in Multiple Sclerosis, Value in Health, 2014, 17, 7, p. A576; ​Available from: http://dx.doi.org/10.1016/j.jval.2014.08.1941;  (http://www.sciencedirect.com/science/article/pii/S1098301514038716)
  16. Gemmen E. et al. PRM153 - Practical approaches to achieving real-world study data representative of the target population, Value in Health, 2014, 17, 3 p. A207; ​Available from: http://dx.doi.org/10.1016/j.jval.2014.03.1210;  (http://www.sciencedirect.com/science/article/pii/S1098301514012613)
  17. Mussolino F. et al. PCV121 - Real world data: a tool for decision making in health care, Value in Health, 2014, 17, 3, p. A123; ​Available from: http://dx.doi.org/10.1016/j.jval.2014.03.715;  (http://www.sciencedirect.com/science/article/pii/S1098301514007669)
  18. Clark O.A.C. et al. PCN39 - Budgetary Impact of Oral Chemotherapy in Brazil: A Real World Data Analysis From The Private Payers’ Perspective, Value in Health, 2014, 17, 3, p. A74; ​Available from: http://dx.doi.org/10.1016/j.jval.2014.03.434;  (http://www.sciencedirect.com/science/article/pii/S1098301514004859)
  19. Purwins S. et al. PSS54 - Health Related Quality of Life-Outcome in National Care - Real World Data from the German Psoriasis-Registry “Psobest”, Value in Health, 2013, 16, 7, p. A511; ​Available from: http://dx.doi.org/10.1016/j.jval.2013.08.1194; (http://www.sciencedirect.com/science/article/pii/S1098301513030994)
  20. Rizvi S.J. et al. Treatment-resistant depression in primary care across Canada Can J Psychiatry 2014,59,7: 349-57
  21. Katodritou E. et al. “Real-world” data on the efficacy and safety of lenalidomide and dexamethasone in patients with relapsed/refractory multiple myeloma who were treated according to the standard clinical practice: a study of the Greek Myeloma Study Group. Ann Hematol. 2014, 93, 1: 129-39; doi: 10.1007/s00277-013-1841-y
  22. Roche N. et al. Quality Standards for Real-World Research. Focus on Observational Database Studies of Comparative Effectiveness. Annals of the American Thoracic Society, 2014, 11, Supplement 2: S99-S104; doi: 10.1513/AnnalsATS.201309-300RM


About Us

Journal of Health Policy & Outcomes Research (JHPOR) is a peer-reviewed, international scientific journal, covering health policy, pharmacoeconomics and outcomes research in Poland and worldwide. The journal is issued under the auspices of the Polish Society of Pharmacoeconomics.

Subscribe to our newsletter:

Latest Articles

Our Contacts

Fundacja PRO MEDICINA
Śliska 3 lok. 55
00-127 Warszawa
NIP 5252390463
REGON 140936540
KRS 0000277843

2017 © Pro Medicina Foundation