The Open Medical Informatics Journal




(Discontinued)

ISSN: 1874-4311 ― Volume 13, 2019

Validating Emergency Department Vital Signs Using a Data Quality Engine for Data Warehouse



N Genes*, 1, D Chandra 2, S Ellis3, K Baumlin1
1 Department of Emergency Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA
2 Information Technology, Mount Sinai Medical Center, New York, NY, USA
3 Research Information Technology, Mount Sinai Medical Center, New York, NY, USA

Abstract

Background:

Vital signs in our emergency department information system were entered into free-text fields for heart rate, respiratory rate, blood pressure, temperature and oxygen saturation.

Objective:

We sought to convert these text entries into a more useful form, for research and QA purposes, upon entry into a data warehouse.

Methods:

We derived a series of rules and assigned quality scores to the transformed values, conforming to physiologic parameters for vital signs across the age range and spectrum of illness seen in the emergency department.

Results:

Validating these entries revealed that 98% of free-text data had perfect quality scores, conforming to established vital sign parameters. Average vital signs varied as expected by age. Degradations in quality scores were most commonly attributed logging temperature in Fahrenheit instead of Celsius; vital signs with this error could still be transformed for use. Errors occurred more frequently during periods of high triage, though error rates did not correlate with triage volume.

Conclusions:

In developing a method for importing free-text vital sign data from our emergency department information system, we now have a data warehouse with a broad array of quality-checked vital signs, permitting analysis and correlation with demographics and outcomes.

Keywords: Data warehouse, electronic health records, emergency medicine, hospital information systems, text mining, user computer interface, vital signs.


Article Information


Identifiers and Pagination:

Year: 2013
Volume: 7
First Page: 34
Last Page: 39
Publisher Id: TOMINFOJ-7-34
DOI: 10.2174/1874431101307010034

Article History:

Received Date: 20/10/2013
Revision Received Date: 11/11/2013
Acceptance Date: 27/11/2013
Electronic publication date: 13/12/2013
Collection year: 2013

© Genes et al.; Licensee Bentham Open.

open-access license: This is an open access article licensed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted, non-commercial use, distribution and reproduction in any medium, provided the work is properly cited.


* Address correspondence to this author at the Department of Emergency Medicine, Icahn School of Medicine at Mount Sinai, Box 1620, One Gustav L. Levy Place, 1190 Fifth Avenue, New York, NY 10029, USA; Tel: 212-824-8073; Fax: 212-426-1946; E-mail: nicholas.genes@mountsinai.org





INTRODUCTION

While various methods have been explored to bring structure to unstructured health data, or to extract clinically meaningful data from unstructured clinical documents [1Meystre SM, Savova GK, Kipper-Schuler KC, Hurdle JF. Extracting information from textual documents in the electronic health record: a review of recent research Yearb Med Inform 2008; 128-44.], there is comparatively little reported on the topic of converting structured data to a more readily analyzable form.

In our Emergency Department (ED) information system, patient vital signs were transcribed electronically, but in separate free-text fields. This practice limits the usefulness of the data outside of its immediate, clinical scope.

Vital signs are an important clinical tool, both for triage decisions [2Cooper RJ, Schriger DL, Flaherty HL, Lin EJ, Hubbell KA. Effect of vital signs on triage decisions Ann Emerg Med 2002; 39: 223-32.] and for monitoring disease progression and therapy efficacy. But vital signs have the potential to aid public health goals and research as well. Vital sign data can augment syndromic surveillance systems in place in many emergency departments [3Meurer W, Smith B, Losman E, et al. Real-time identification of serious infection in geriatric patients using clinical information system surveillance J Am Geriatr Soc 2009; 57: 40-5.]. Public health researchers can monitor hypertension prevalence in a community through collected ED vitals signs data [4Kaszuba A, Matanoski G, Gibson G. Evaluation of the emergency department as a site for hypertension screening JACEP 1978; 7: 51-.,5Chernow S, Iserson K, Criss E. Use of the Emergency Department for hypertension screening: a prospective study Ann Emerg Med 1987; 16: 180-2.]. Decision support tools can be triggered or adjusted based on vital sign analysis [3Meurer W, Smith B, Losman E, et al. Real-time identification of serious infection in geriatric patients using clinical information system surveillance J Am Geriatr Soc 2009; 57: 40-5., 6Haukoos J, Byyny R, Erickson C, et al. Validation and refinement of a rule to predict emergency intervention in adult trauma patients Ann Emerg Med 2011; 58: 164-71.].

To make use of vital signs for research and quality assurance purposes, we embarked upon a project to convert vital sign values, recorded as plain text, to numerical format, upon their extraction to a data warehouse.

A 1:1 conversion from text to numeric data, however, would result in the inclusion of many erroneous values and lead to poor data quality in the warehouse. So we developed a process for transforming data exhibiting common errors of text entry (such as commas instead of decimal points, or temperatures in Celsius instead of Fahrenheit), and assigning quality scores to the transformed data based on the steps required to deliver physiologic vital signs.

This effort posed an immediate challenge, as emergency department patients include the very young and old, with some patients in relatively good health and others in extremis. There is likely no other setting in healthcare delivery where such variability in vital signs is routinely encountered. And while the range of what can be considered normal or abnormal for a given age is generally agreed upon [7Edmonds Z, Mower W, Lovato L, Lomeli R. The reliability of vital sign measurements Ann Emerg Med 2002; 39: 233-7.-10Armstrong B, Walthall H, Clancy M, Mullee M, Simpson H. Recording of vital signs in a district general hospital emergency department Emerg Med J 2008; 25: 799-802.], there is little data on the prevalence of abnormal vitals, the true range of vitals encountered in the emergency department [11Edmonds Z, Mower W, Lovato L, Lomeli R. The reliability of vital sign measurements Ann Emerg Med 2002; 39: 233-7.], or factors influencing the error rate while recording vitals [11Edmonds Z, Mower W, Lovato L, Lomeli R. The reliability of vital sign measurements Ann Emerg Med 2002; 39: 233-7.-14Goyal M, Hollander J, Galeski D. Images in emergency medicine Synypnea Ann Emerg Med 2005; 46: 469.].

Thus, to determine the appropriateness of vital sign transform rules and determine the quality of imported vital sign data, proposed rules were retrospectively derived from a set of emergency department vital signs, and then prospectively applied to a wider set.

We hypothesized that analyzing the free-text entries for vital signs would reveal, for the vast majority of cases, usable and clinically appropriate information, but that some small fraction of data would require transformation (such as changing Fahrenheit to Celsius, or deleting an extraneous character) to be usable, and some data would be so confusingly inappropriate as to not be usable at all.

Regarding the vital sign data itself, we hypothesized that the average vital sign data would conform to expected human physiologic parameters, such as heart rate, pulse oximetry, and blood pressure changes with respect to age, and that daily variations in blood pressure and seasonal variations in temperature might be observed. Furthermore, we expected this set of vital signs would suggest a particular period of the day when errors in entry were most common, though it was unclear whether this period of highest errors would be associated with the stress that comes with high patient census (later afternoons and evenings, in our facility), or boredom that comes with low volume (the predawn hours, in our ED).

The wider purpose in reporting our observations here is twofold. First, the transformation rules we validated should have immediate bearing on the clinical data tasks informaticists and information technology (IT) personnel find themselves facing today, such as minimizing errors, making data available for health information exchange [15Shapiro J, Mostashari F, Hripcsak G, Soulakis N, Kuperman G. Using health information exchange to improve public health Am J Public Health 2011; 191: 616-23.], demonstrating meaningful use of electronic health records [16CMS EHR Incentive Program FAQ https //questionscmshhsgov/ app/answers/detail/a_id/10593/p/21 2611 Accessed November 15 2011.], or complying with accountable care organization goals for blood pressure control in at-risk populations.

Secondly, in the course of this work, we generated what we believe is the first comprehensive data set demonstrating the range of emergency department vital signs. Using a data warehouse to correlating vitals with comorbidities, laboratory results or outcomes data may help identify patients at particular risk, and help marshal resources to manage at-risk patients more efficiently.

METHODS

For the derivation phase of this project, assessments of all unique values of Heart Rate (HR), Respiratory Rate (RR), Temperature (T), Blood Pressure (BP) and Oxygen Saturation (SpO2) were extracted from the ED information system (Picis, Wakefield, Massachusetts) over a date range of one month (December 2009). In our large urban academic emergency department, which includes pediatric patients and sees approximately 100,000 visits per year, vitals are typically entered by nurses at triage and again by technicians, nurses and physicians at regular intervals during the patient visit, depending on their complaint and degree of illness.

The vital sign extraction was performed using HL7 interface and Extract-Transfer-Load (ETL) tools in the Mount Sinai Data Warehouse (MSDW). The MSDW contains data extracted from twenty of Mount Sinai’s clinical and financial systems, including all 2.7 million patients in the Master Person Index and over one billion facts for these patients. Database searches are performed with an internally developed Cohort Query Tool written in Java. The MSDW is compliant with HIPAA and New York State privacy and security regulations and with institutional policy regarding protection of human subjects and participation in research.

Extract-Transfer-Load (ETL) processes are written in Business Objects Data Integrator and Oracle stored procedures, and the Rules Engine in the MSDW is an in-house developed component of our ETL process. Every transaction loaded to MSDW is processed through the Rules Engine, and actions are applied according to the nature of the transaction and matching rules. These actions are typically a data quality score reduction. Rules are formulated by extensive profiling of the source data, and in consultation with subject matter experts. Typical data quality issues that result in quality score deductions include removing special characters from free-text data or data that falls outside the range experts consider possible. The magnitude of these deductions – from 5 points to a full 100 point deduction - are based on user’s impressions of the meaningfulness of imported data.

Text values for vital signs were analyzed, and rules for deducting points from quality scores were developed, as a search of the literature, web and our colleagues revealed no applicable set of transformation rules. We developed rules (see Appendix A) based on commonly accepted ranges for human physiology and some of our judgments (NG, KB) as emergency physicians, and also as users of the Picis system, for what would make a reasonable deduction in score.

The rules engine was then applied to automatically identify, cleanse, and score uploaded vital sign data. This validation phase involved applying the derived rules to data collected over a period of from January 1, 2010 to July 30, 2010. An iterative text parsing mechanism was used to process the free-text vital sign data, so data type corrections could be performed (such as assigning proper units of measure). The Rule Engine reduced quality score based on the number and types of efforts necessary to process the original data. The end result was a cumulative score assigned to every vital sign “fact” entered into the data warehouse.

OBSERVATIONS

From the derivation cohort of unique values of heart rate, respiratory rate, blood pressure (separated here as systolic and diastolic values) temperature and pulse oximetry, we developed the transform rules (see Appendix A).

Applying these rules prospectively over a period of 6 months of collected HL7 messages from the emergency department led to the generation of our prospective data set of vital signs, which consisted of 497,302 detected vital sign fields, from 30,269 distinct medical record numbers associated with 41,624 visits. 799 patients had fields associated with no usable data (for these cases, typically one field would be used to indicate the patient refused or vital signs could not be obtained).

98% of the imported vital signs in the validation set had a quality score of 100, with an additional 1.3% of signs achieving a score of 95 and 0.3% having a score of 90. Scores between 0 and 90 occurred 147 times (0.02%) and there were 1079 instances of quality scores of 0 (0.21%).

The reason most vital signs had quality score points deducted was a use of Fahrenheit instead of Celsius for the temperature field, and the reason most scores fell below 90 and hence, outside the range of usable data, was because of pulse oximeter values outside physiologic norms or above 100% (see Table 1).

Table 1

Importation Rules and Failure Counts Upon Validation




Comparatively, deductions in the quality score of heart rate, respiratory rate and blood pressure were less common that those for temperature and pulse oximetry (see Table 1).

The average values for respiratory rate, heart rate, blood pressure, temperature and pulse oximetry, along with standard deviations and range, are shown in Table 2A.

Table 2A

Statistics on Validated Vital Signs




Table 2B

Statistics on Validated Vital Signs, Stratified by Patient Age




Heart and respiratory rate were recorded more often than blood pressure and pulse oximetry and over twice as often as temperature. Rectal temperature was least commonly employed but was consistently higher than tympanic temperature, perhaps reflecting clinical suspicion of a fever before ordering the procedure.

When plotted by age, the vital signs confirm physiologic expectations; heart rates and oxygen saturation decline with age, while blood pressure rises (Table 2B).

There was no daily variation in blood pressure and no seasonal variation in temperature (data not shown), as others have suggested in non-emergency cohorts [17Lu SH, Leasure AR, Dai YT. A systematic review of body temperature variations in older people J Clin Nurs 2010; 19: 4-16., 18Hozawa A, Kuriyama S, Shimazu T, Ohmori-Matsuda K, Tsuji I. Seasonal variation in home blood pressure measurements and relation to outside temperature in Japan Clin Exp Hypertens 2011; 33: 153-8.].

The time period most associated with low quality scores (370 total) was from 9-10pm, which is ten hours after the time of peak intake time (when most patients receive a set of vital sign measurements) in our emergency department, but at the tail end of the peak occupancy rate [19McCarthy ML, Aronsky D, Jones ID, et al. The emergency department occupancy rate: a simple measure of emergency department crowding? Ann Emerg Med 2008; 51: 15-24.] (which remains consistently high from 3pm until 10pm). The fewest low-quality vitals (106 total) were recorded between 5-6am, which is associated with both the lowest intake and lowest occupancy in the department. The rate of error per patient triaged at this early morning hour, however, was approximately equal to (in fact, slightly higher than) the 9-10pm error rate per patient triaged (0.190 vs 0.178), despite a much lower influx of patients and a much lower patient census.

DISCUSSION

In the process of importing free-text vital sign data from our emergency department information system, we now have a data warehouse with quality-checked emergency department vital signs. We can now analyze what may be the broadest set of human vital signs yet reported, encompassing neonates to centenarians, the mostly-well to the moribund. Prior to processing this data, applying transforms when necessary, and importing the data into the MSDW, analysis of our ED’s vital sign characteristics, such as determining standard deviations or averages based on age, was not possible.

The usefulness of this data is manifold. First, just as some [20Aller R. The clinical laboratory data warehouse.An overlooked diamond mine Am J Clin Pathol 2003; 120: 817-9., 21Jenkins J, MacCrawford J, Bissell M. Studying critical values: adverse event identification following a critical laboratory values study at the Ohio State university medical center Am J Clin Pathol 2007; 128: 604-9.] have argued that clinical lab values are a valuable resource for studying outcomes and disease progression, so too can vital sign warehousing demonstrate significance for health prognostication, especially when correlated with outcomes data demographic information, diagnoses and comorbidities, laboratory and imaging results.

Second, our transforms were very useful. In EMR, users have demonstrated preference for free-text fields [22van Ginneken A, Verkoijen M. A multi-disciplinary approach to a user interface for structured data entry Stud Health Technol Inform 2001; 84: 693-7.] and we’ve shown that we can capture meaningful data from over 98% of these fields. This system preserves the best of both worlds: preserving free-text entry fields preventing frustrating data entry experiences in the chaotic environment of the ED, and the transforms allow meaningful data to be graded or salvaged.

Furthermore, the transformation rules we validated will have immediate application to the clinical data tasks informaticists and IT personnel find themselves facing today, in making data available for health information exchange, demonstration of meaningful use of electronic health records, or compliance with accountable care organization goals [15Shapiro J, Mostashari F, Hripcsak G, Soulakis N, Kuperman G. Using health information exchange to improve public health Am J Public Health 2011; 191: 616-23.,16CMS EHR Incentive Program FAQ https //questionscmshhsgov/ app/answers/detail/a_id/10593/p/21 2611 Accessed November 15 2011.].

We suspect hospital QA efforts may be aided by the finding that quality scores per patient triaged are relatively low, and by inference, data entry error rates are highest, in the pre-dawn hours. At the very least, this finding may help guide staffing and break time decisions.

Prior studies on the usefulness of vital signs in the ED have focused on accuracy and precision of measurements. Our database can serve as a standard by which future ED studies can compare averages, variation and ranges in human vital signs.

The compilation of this data now makes possible determinations such as "the average ED patient temperature" or "the fraction of patients with abnormal vitals." Additionally, simple correlations that have long been suspected, such as pain and heart rate [23Lord B, Woollard M. The reliability of vital signs in estimating pain severity among adult patients treated by paramedics Emerg Med J 2011; 28: 147-50.], may be easily researched.

CONFLICT OF INTEREST

The authors confirm that this article content has no conflicts of interest.

ACKNOWLEDGEMENTS

This research was deemed exempt from review of the Mount Sinai Program for the Protection of Human Subjects.

APPENDIX A

Logic for Vital Sign Transformations

Pulse: a range between 30 and 250 (outside of which quality is set to 0).

Transformation:

remove all special characters other than '-', '.', '%'

If value reported as ‘a-b’, take the highest, reduce quality score by 10

If value is decimal, take the whole number before the decimal point, set data quality score to 0

If the value has ‘%’ take the whole number before the ‘%’, set data quality score to 0

Respiratory Rate: a range between 6 and 60, outside of which quality is set to 0.

Transformation:

removal all special characters other than '-', '.'

If value reported as ‘a-b’, take the highest value and reduce quality score by 10

If value is decimal, set data quality score to 0

Systolic & Diastolic Blood Pressure: A range from 30-305 for systole, 20-180 for diastole.

Transformation:

Take the value before '/' as 'SBP' and the value after '/' as 'DBP'

Range of SBP is 30-305, range of DBP is 20-180. Values outside that range are given a quality score of 0.

if SBP or DBP is left blank or one has alphanumeric, then load both in SBP/DBP Comments, set quality score to 0.

Remove '-', '%', '.', and space in between the numbers. If these characters are found, reduce data quality score by 5.

If DBP > SBP or SBP = DBP, set the quality score of both to 0

If SBP/DBP is 0/0, then set the quality score to 0.

set any 0 or blank to a quality of 0, as with any value less than 20.

In all cases where the recorded value (after stripping any leading and trailing non-numeric characters) is not in the form of xxx/yyy where xxx>yyy, we stored the full entered value in the comment field. There are no SBP or DBP facts stored, so there is no opportunity to assign a quality score to either SDP or DBP, and the quality score of the Comment field is set to 0 (giving a way to differentiate these comments from other comments for future reference).

Oxygen Saturation: A range from 60 to 100 (with anything outside that range set to a quality score of 0). Transformation:

Consider the numeric value before first '%' or space. If it’s a text character, then load the comments with source as-is, set quality score to 0.

Clinical Result(O2 Saturation) should be a whole number, else reduce quality score by 5

Remove '$','*', '-','.' between Number and '%' and if resulting value is in range, reduce quality score by 10, else set quality score to 0

For entries marked “UT0” (“unable to obtain”) Set UT0[zero] to UTO, load into comments, set quality score to 0

Temperature: The Celsius range runs from 29.5 to 41.5 (outside of which quality score is set to 0).

Transformation:

Temperatures recorded in the range between 85-105 were assumed as Fahrenheit, converted to Celsius by subtracting 32 then multiplying by 5/9ths. For temperatures that come suffixed with alpha characters (such as F, C, T, R, O). We stripped off the alpha part and storing the numeric part as a numeric fact and the alpha part as a Comment (text) fact.

For temperatures containing punctuation other than a decimal point between digits (such as a comma): in these cases we changed the punctuation to a decimal point.

Any ‘,’ or ‘;’ in values are converted to ‘.’, reduce quality score by 5

If the value is above the range, assume a missing period and divide it by 10 to get the actual value. If the value is If the actual value derived is still above range set quality score to 0, else reduce quality score by 10.

When value in oF is converted to oC

If value has 'C' suffix, consider as 'oC'

If value like ‘a-b’, take the highest value and reduce quality score by 10.

REFERENCES

[1] Meystre SM, Savova GK, Kipper-Schuler KC, Hurdle JF. Extracting information from textual documents in the electronic health record: a review of recent research Yearb Med Inform 2008; 128-44.
[2] Cooper RJ, Schriger DL, Flaherty HL, Lin EJ, Hubbell KA. Effect of vital signs on triage decisions Ann Emerg Med 2002; 39: 223-32.
[3] Meurer W, Smith B, Losman E, et al. Real-time identification of serious infection in geriatric patients using clinical information system surveillance J Am Geriatr Soc 2009; 57: 40-5.
[4] Kaszuba A, Matanoski G, Gibson G. Evaluation of the emergency department as a site for hypertension screening JACEP 1978; 7: 51-.
[5] Chernow S, Iserson K, Criss E. Use of the Emergency Department for hypertension screening: a prospective study Ann Emerg Med 1987; 16: 180-2.
[6] Haukoos J, Byyny R, Erickson C, et al. Validation and refinement of a rule to predict emergency intervention in adult trauma patients Ann Emerg Med 2011; 58: 164-71.
[7] Edmonds Z, Mower W, Lovato L, Lomeli R. The reliability of vital sign measurements Ann Emerg Med 2002; 39: 233-7.
[8] Chan S, Cattermole G, Leung P, Mak P, Graham C, Rainer T. Validation of the APLS age-based vital signs reference ranges in a Chinese population Resuscitation 2011; 82: 891-5.
[9] Wallis L, Healy M, Undy M, Maconochie I. Age related reference ranges for respiration rate and heart rate from 4 to 16 years Arch Dis Child 2005; 90: 1117-21.
[10] Armstrong B, Walthall H, Clancy M, Mullee M, Simpson H. Recording of vital signs in a district general hospital emergency department Emerg Med J 2008; 25: 799-802.
[11] Edmonds Z, Mower W, Lovato L, Lomeli R. The reliability of vital sign measurements Ann Emerg Med 2002; 39: 233-7.
[12] Lovett P, Buchwald J, Sturmann K, Bijur P. The vexatious vital: neither clinical measurements by nurses nor an electronic monitor provides accurate measurements of respiratory rate in triage Ann Emerg Med 2005; 45: 68-76.
[13] Worster A, Elliott L, Bose T, Chemeris E. Reliability of vital signs measured at triage Eur J Emerg Med 2003; 10: 108-.
[14] Goyal M, Hollander J, Galeski D. Images in emergency medicine Synypnea Ann Emerg Med 2005; 46: 469.
[15] Shapiro J, Mostashari F, Hripcsak G, Soulakis N, Kuperman G. Using health information exchange to improve public health Am J Public Health 2011; 191: 616-23.
[16] CMS EHR Incentive Program FAQ https //questionscmshhsgov/ app/answers/detail/a_id/10593/p/21 2611 Accessed November 15 2011.
[17] Lu SH, Leasure AR, Dai YT. A systematic review of body temperature variations in older people J Clin Nurs 2010; 19: 4-16.
[18] Hozawa A, Kuriyama S, Shimazu T, Ohmori-Matsuda K, Tsuji I. Seasonal variation in home blood pressure measurements and relation to outside temperature in Japan Clin Exp Hypertens 2011; 33: 153-8.
[19] McCarthy ML, Aronsky D, Jones ID, et al. The emergency department occupancy rate: a simple measure of emergency department crowding? Ann Emerg Med 2008; 51: 15-24.
[20] Aller R. The clinical laboratory data warehouse.An overlooked diamond mine Am J Clin Pathol 2003; 120: 817-9.
[21] Jenkins J, MacCrawford J, Bissell M. Studying critical values: adverse event identification following a critical laboratory values study at the Ohio State university medical center Am J Clin Pathol 2007; 128: 604-9.
[22] van Ginneken A, Verkoijen M. A multi-disciplinary approach to a user interface for structured data entry Stud Health Technol Inform 2001; 84: 693-7.
[23] Lord B, Woollard M. The reliability of vital signs in estimating pain severity among adult patients treated by paramedics Emerg Med J 2011; 28: 147-50.
Track Your Manuscript:


Endorsements



"Open access will revolutionize 21st century knowledge work and accelerate the diffusion of ideas and evidence that support just in time learning and the evolution of thinking in a number of disciplines."


Daniel Pesut
(Indiana University School of Nursing, USA)

"It is important that students and researchers from all over the world can have easy access to relevant, high-standard and timely scientific information. This is exactly what Open Access Journals provide and this is the reason why I support this endeavor."


Jacques Descotes
(Centre Antipoison-Centre de Pharmacovigilance, France)

"Publishing research articles is the key for future scientific progress. Open Access publishing is therefore of utmost importance for wider dissemination of information, and will help serving the best interest of the scientific community."


Patrice Talaga
(UCB S.A., Belgium)

"Open access journals are a novel concept in the medical literature. They offer accessible information to a wide variety of individuals, including physicians, medical students, clinical investigators, and the general public. They are an outstanding source of medical and scientific information."


Jeffrey M. Weinberg
(St. Luke's-Roosevelt Hospital Center, USA)

"Open access journals are extremely useful for graduate students, investigators and all other interested persons to read important scientific articles and subscribe scientific journals. Indeed, the research articles span a wide range of area and of high quality. This is specially a must for researchers belonging to institutions with limited library facility and funding to subscribe scientific journals."


Debomoy K. Lahiri
(Indiana University School of Medicine, USA)

"Open access journals represent a major break-through in publishing. They provide easy access to the latest research on a wide variety of issues. Relevant and timely articles are made available in a fraction of the time taken by more conventional publishers. Articles are of uniformly high quality and written by the world's leading authorities."


Robert Looney
(Naval Postgraduate School, USA)

"Open access journals have transformed the way scientific data is published and disseminated: particularly, whilst ensuring a high quality standard and transparency in the editorial process, they have increased the access to the scientific literature by those researchers that have limited library support or that are working on small budgets."


Richard Reithinger
(Westat, USA)

"Not only do open access journals greatly improve the access to high quality information for scientists in the developing world, it also provides extra exposure for our papers."


J. Ferwerda
(University of Oxford, UK)

"Open Access 'Chemistry' Journals allow the dissemination of knowledge at your finger tips without paying for the scientific content."


Sean L. Kitson
(Almac Sciences, Northern Ireland)

"In principle, all scientific journals should have open access, as should be science itself. Open access journals are very helpful for students, researchers and the general public including people from institutions which do not have library or cannot afford to subscribe scientific journals. The articles are high standard and cover a wide area."


Hubert Wolterbeek
(Delft University of Technology, The Netherlands)

"The widest possible diffusion of information is critical for the advancement of science. In this perspective, open access journals are instrumental in fostering researches and achievements."


Alessandro Laviano
(Sapienza - University of Rome, Italy)

"Open access journals are very useful for all scientists as they can have quick information in the different fields of science."


Philippe Hernigou
(Paris University, France)

"There are many scientists who can not afford the rather expensive subscriptions to scientific journals. Open access journals offer a good alternative for free access to good quality scientific information."


Fidel Toldrá
(Instituto de Agroquimica y Tecnologia de Alimentos, Spain)

"Open access journals have become a fundamental tool for students, researchers, patients and the general public. Many people from institutions which do not have library or cannot afford to subscribe scientific journals benefit of them on a daily basis. The articles are among the best and cover most scientific areas."


M. Bendandi
(University Clinic of Navarre, Spain)

"These journals provide researchers with a platform for rapid, open access scientific communication. The articles are of high quality and broad scope."


Peter Chiba
(University of Vienna, Austria)

"Open access journals are probably one of the most important contributions to promote and diffuse science worldwide."


Jaime Sampaio
(University of Trás-os-Montes e Alto Douro, Portugal)

"Open access journals make up a new and rather revolutionary way to scientific publication. This option opens several quite interesting possibilities to disseminate openly and freely new knowledge and even to facilitate interpersonal communication among scientists."


Eduardo A. Castro
(INIFTA, Argentina)

"Open access journals are freely available online throughout the world, for you to read, download, copy, distribute, and use. The articles published in the open access journals are high quality and cover a wide range of fields."


Kenji Hashimoto
(Chiba University, Japan)

"Open Access journals offer an innovative and efficient way of publication for academics and professionals in a wide range of disciplines. The papers published are of high quality after rigorous peer review and they are Indexed in: major international databases. I read Open Access journals to keep abreast of the recent development in my field of study."


Daniel Shek
(Chinese University of Hong Kong, Hong Kong)

"It is a modern trend for publishers to establish open access journals. Researchers, faculty members, and students will be greatly benefited by the new journals of Bentham Science Publishers Ltd. in this category."


Jih Ru Hwu
(National Central University, Taiwan)


Browse Contents




Webmaster Contact: info@benthamopen.net
Copyright © 2023 Bentham Open