SlideShare a Scribd company logo
1 of 6
Download to read offline
Full Terms & Conditions of access and use can be found at
http://www.tandfonline.com/action/journalInformation?journalCode=khvi20
Download by: [88.7.7.207] Date: 24 November 2015, At: 22:58
Human Vaccines & Immunotherapeutics
ISSN: 2164-5515 (Print) 2164-554X (Online) Journal homepage: http://www.tandfonline.com/loi/khvi20
Intussusception following rotavirus vaccination in
the Valencia Region, Spain
Silvia Pérez-Vilar, Javier Díez-Domingo, Joan Puig-Barberà, Ruth Gil-Prieto &
Silvana Romio
To cite this article: Silvia Pérez-Vilar, Javier Díez-Domingo, Joan Puig-Barberà, Ruth Gil-
Prieto & Silvana Romio (2015) Intussusception following rotavirus vaccination in the
Valencia Region, Spain, Human Vaccines & Immunotherapeutics, 11:7, 1848-1852, DOI:
10.1080/21645515.2015.1049787
To link to this article: http://dx.doi.org/10.1080/21645515.2015.1049787
© 2015 The Author(s). Published with
license by Taylor and Francis Group, LLC©
Silvia Pérez-Vilar, Javier Díez-Domingo, Joan
Puig-Barberà, Ruth Gil-Prieto, and Silvana
Romio
View supplementary material
Accepted author version posted online: 17
Jun 2015.
Submit your article to this journal
Article views: 149
View related articles
View Crossmark data
Intussusception following rotavirus vaccination
in the Valencia Region, Spain
Silvia Perez-Vilar1,2,*, Javier Díez-Domingo1,3
, Joan Puig-Barbera1
, Ruth Gil-Prieto4
, and Silvana Romio2,5
1
Vaccine Research Fundacion para el Fomento de la Investigacion Sanitaria y Biomedica de la Comunitat Valenciana; FISABIO-Public Health; Valencia, Spain;
2
Department of Medical Informatics; Erasmus University Medical Center; Rotterdam, The Netherlands; 3
Facultad de Medicina; Universidad Catolica de Valencia “San Vicente Martir;
Valencia, Spain; 4
Area of Preventive Medicine and Public Health; Rey Juan Carlos University; Madrid, Spain; 5
Department of Statistics and Quantitative Methods; Division of
Biostatistics; Epidemiology and Public Health; Laboratory of Healthcare Research and Pharmacoepidemiology; University of Milano-Bicocca; Milan, Italy
Keywords: intussusception, positive predictive value, rotavirus vaccines, self-controlled case-series (SCCS) method, vaccine safety
Abbreviations: CI, Confidence Interval; CMBD, Spanish hospital discharge database; IRRs, Incidence Rate Ratios; PPV, Positive
Predictive Value; RV1, RotarixÒ
(GlaxoSmithKline Biologicals Rixensart Belgium); RV5, RotaTeqÒ
(Merck  Co. Inc. West Point
PA USA); SCCS, Self-Controlled Case Series; SIV, Valencias Vaccine Information System
Studies have shown high intussusception rates in Spain. We performed a hospital-based retrospective observational
study of the intussusception risk following rotavirus vaccinations among infants in Valencia, a region of Spain with an
annual birth cohort of approximately 48,000 children, during 2007–2011, using a self-controlled case series design. We
performed medical record review of all cases using Brighton Collaborations case definition and assessed the positive
predictive value (PPV) of the intussusception diagnosis code. Among 151 hospitalized cases discharged as
intussusception, we confirmed 136 as Brighton Collaboration’s Levels 1 or 2, resulting in a PPV of 93% (95% CI:
87%–96%). Three confirmed cases occurred within days 1–7 following the first rotavirus vaccination. The incidence rate
ratio was 9.0 (95% CI: 0.9–86.5) (crude) and 4.7 (95% CI:0.3–74.1)(age adjusted). In this first study in Europe, the
intussusception risk point estimate was comparable to other studies, although results were not statistically significant,
maybe due to limited power. The high PPV found will facilitate implementation of a larger study without requiring
medical record review. Our finding of very few vaccinated cases despite a thorough 5-year investigation in a country
that, according to previous studies, may have a large background rate of intussusception is reassuring and should
contribute to deliberations about the need to include rotavirus vaccines in the official Spanish calendars.
Manuscript
Two oral live-attenuated rotavirus vaccines are currently available
in the global market: a monovalent human vaccine, RotarixÒ
(Glax-
oSmithKline Biologicals, Rixensart, Belgium), indicated as a 2-dose
series in infants between the ages of 6–12 and 24 weeks,1
and a pen-
tavalent bovine-human reassortant vaccine, RotaTeqÒ
(Merck 
Co., Inc., West Point, PA, USA), indicated as a 3-dose series starting
at age 6–12 weeks and ending at age 32 weeks.2
Previously, an
observed association between RotashieldÒ
, the first licensed rotavirus
vaccine, and intussusception, caused its withdrawal from the US
market in 1999, only 9 months after licensure.3,4
The pre-licensure
clinical trials for both RotarixÒ
(RV1) and RotaTeqÒ
(RV5),
designed to exclude an association with intussusception of similar
magnitude than that found for RotashieldÒ
, did not find an associa-
tion.5,6
However, after licensure, an increased risk, although of
much lower magnitude, was found with both vaccines in Australia,
Mexico, Brazil, and the United States.7-10
Both vaccines, RV1 and RV5, have been available in Spain
since August 2006 and January 2007, respectively. Rotavirus vac-
cines in Spain are not funded by the National Health System,
but are recommended by scientific societies and most pediatri-
cians, and paid for by parents. Due to the incidental finding of
circovirus DNA contamination affecting both vaccines, the Span-
ish Medicines Agency suspended RV5 distribution during June-
November 2010, and RV1 distribution since March 2010.11
As
of this publication, RV1 remains suspended in Spain.
Intussusception risk varies across population and regions,12
and some studies have shown high background rates of intussus-
ception in Spain;13,14
a potential association with rotavirus vacci-
nation could cause concern. Thus, our aim was to investigate
such association in the Valencia Region, Spain.
© Silvia Perez-Vilar, Javier Díez-Domingo, Joan Puig-Barbera, Ruth Gil-Prieto, and Silvana Romio
*Correspondence to: Silvia Perez-Vilar; Email: perez_silvil@gva.es
Submitted: 02/24/2015; Revised: 04/19/2015; Accepted: 05/06/2015
http://dx.doi.org/10.1080/21645515.2015.1049787
This is an Open Access article distributed under the terms of the Creative Commons Attribution-Non-Commercial License (http://creativecommons.org/licenses/
by-nc/3.0/), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. The
moral rights of the named author(s) have been asserted.
1848 Volume 11 Issue 7Human Vaccines  Immunotherapeutics
Human Vaccines  Immunotherapeutics 11:7, 1848--1852; July 2015; Published with license by Taylor  Francis Group, LLC
SHORT REPORT
Downloadedby[88.7.7.207]at22:5824November2015
We performed a hospital-based retrospective observational
study during January 1, 2007 – December 31, 2011. Intussus-
ception risk following rotavirus vaccinations was assessed using a
self-controlled cases series (SCCS) design.15
The SCCS is a case-
only design that uses individuals who had the event of interest
during the study period; we applied the vaccinated cases only
SCCS approach, which uses only subjects who were exposed to a
rotavirus vaccine.16
Therefore, inference is done within individu-
als, and time-fixed confounders are controlled implicitly by
design. Unvaccinated individuals and individuals for which vacci-
nation status is unknown are excluded. The observation period
(follow-up person-time) for each individual is divided
in predefined risk and non-risk periods based on exposure.
Therefore, the event of interest falls either into a risk or a non-
risk period.15
In our case, the risk periods were defined as days
1–7, and 8–21, post-vaccination, following each dose of any rota-
virus vaccine. The comparison (non-risk) period was days 22–42
following each dose. The study included assessment of the posi-
tive predictive value (PPV) of the intussusception code used in
the Spanish hospital discharge database, CMBD.17
Almost all the Valencia Region population (98%) is covered
by the public health system,18
and all users have a unique identi-
fication number that allows linking all health care databases and
all medical records.
Potential intussusception cases among resident infants aged
6–42 weeks, irrespective of their rotavirus vaccination status, were
identified from CMBD through the ICD-9-CM code 560.0 in
any diagnosis position. A review of hospitalization and primary
care medical records of all potential cases was carried out using
the standardized Brighton Collaboration case definition for intus-
susception (see the Table S1 showing the Brighton criteria in the
Appendix).19
First intussusception episodes considered confirmed
(Brighton Level 1-Level 2) were included in the analyses. In our
study, the event date was the date of onset of symptoms.
The exposure of interest was vaccination with any dose of
rotavirus vaccines. Rotavirus vaccination status was obtained
from the regional vaccine information system, SIV.20
Lack of
information or inconsistencies were confirmed through phone
consultation with parents and verbal verification of the informa-
tion in the childs vaccination card.
Dose-specific incidence rate ratios (IRRs), and their 95% con-
fidence intervals (CI), were assessed to investigate the association
between confirmed intussusception cases and rotavirus vaccines
within the 2 predefined risk periods. The IRR is estimated by
within-individual comparisons of the incidence of the event of
interest in risk and control periods using person-time denomina-
tors. Given the strong confounding effect of age, analyses were
adjusted using, as reference, intussusception-hospitalized rates
by age in unvaccinated Valencia Regions children during
2001–2011.10
Specific rates by age were estimated using data from
CMBD and from the Spanish Statistical Office database (www.
ine.es); the pattern was modeled using spline function (Fig. 1).
The PPVs were assessed for the different categories of Brigh-
ton Collaboration case classification: (1) Level 1, (2) Level
1-Level 2, and (3) Levels 1-Level 2-Level 3. They were stratified
for discharge code position and calendar year.
All statistical tests were 2-sided. Statistical significance was
defined as p  0.05. Analyses were performed using Stata/SE
13.1 (StataCorp LP Texas, USA), R 3.0.3 (Foundation for Statis-
tical Computing, Vienna, Austria), SAS 9.2 (SAS Institute, Inc.),
and SAS macros developed by Bart Spiessens.
The study was conducted according to the existing legislation
including the Good Epidemiological Practices (CIOMS 2009),
the Helsinki Declaration (Seoul 2008) and the Law 14/2007, of
3 July, on Biomedical Research, and was approved by the Ethics
Research Committee of the Direccion General de Salud Publica/
Centro Superior de Investigacion en Salud Publica, which pro-
vided a waiver to access personal information and contact
parents.
The Valencia Region has an annual birth cohort of around
48,000 infants among a total population of approximately
5,000,000 inhabitants. Within the population of interest, infants
aged 6 to 42 weeks discharged from hospitals of the Valencia
Regions public health system, 151 potential hospitalized-intus-
susception cases were identified after having excluded duplicate
episodes (children transferred to a reference hospital). Cases
occurred in 147 infants, since 4 infants (3%) had a second epi-
sode. Medical records were available for all cases. Among first
episodes, 125 cases (85.0%) were classified as Level 1, 11 (7.5%)
as Level 2, 2 (1.4%) as Level 3, 8 (5.4%) as Insufficient Evidence,
and one case (0.7%) was discarded. Of 136 confirmed intussus-
ception cases, 35 (26%) occurred in rotavirus-vaccinated children
(Fig. 2). Among them, 14 (40%), and 21 (60%) had received
RV1 and RV5, respectively.
The PPV of the diagnosis code for hospitalized intussuscep-
tion cases (any discharge diagnosis position) was 93% (95% CI:
87%–96%) for Level 1-Level 2 of diagnosis certainty. No differ-
ences by discharge diagnosis position or by calendar year were
found (Table 1).
Figure 1. Intussusception-hospitalized rates by age in unvaccinated
Valencia Regions children aged less than 12 months during 2001–2011.
www.tandfonline.com 1849Human Vaccines  Immunotherapeutics
Downloadedby[88.7.7.207]at22:5824November2015
Three intussusception cases occurred within days 1–7 follow-
ing first dose of a rotavirus vaccine (two after RV1 and one after
RV5) resulting in a crude IRR point estimate of 9.0 (95%
CI: 0.9–86.5), and in an age-adjusted estimate of 4.7 (95%
CI:0.3–74.1) within this risk window. The number of cases
occurring within 1–7, 8–21, and 22–42 days following each
dose, and dose-specific IRRs are shown in Table 2.
In this first post-licensure analytical study of the intussuscep-
tion risk following rotavirus vaccination in Europe, we investi-
gated intussusception cases among infants discharged from all
Figure 2. Flowchart of hospitalized-intussusception cases.
Table 1. Positive predictive values according to The Brighton Collaboration case classification by discharge code position, and by calendar year
Positive Predictive Values
Cases
n Level 1% (95% CI)
Level 1- Level 2
% (95% CI)
Level 1-Level 2-Level 3
% (95% CI)
Discharge code position
1st
148 86.5 (79.9–91.5) 93.2 (87.9–96.7) 94.6 (89.6–97.6)
1st
or 2nd
149 86.6 (80.0–91.6) 93.3 (88.0–96.7) 94.6 (89.7–97.7)
Any 151 85.4 (78.8–90.6) 92.7 (87.3–96.3) 94.0 (89.0–97.2)
Calendar year1
2007 44 81.8 (67.3–91.8) 90.9 (78.3–97.5) 95.5 (84.5–99.4)
2008 30 86.7 (69.3–96.2) 93.3 (77.9–99.2) 93.3 (77.9–99.2)
2009 25 84.0 (63.9–95.5) 92.0 (74.0–99.0) 92.0 (74.0–99.0)
2010 28 89.3 (71.8–97.7) 92.9 (76.5–99.1) 92.9 (76.5–99.1)
2011 24 87.5 (67.6–97.3) 95.8 (78.9–99.9) 95.8 (78.9–99.9)
1
Any diagnosis position.
Abbreviations: Positive Predictive Value (PPV); Confidence interval (CI).
1850 Volume 11 Issue 7Human Vaccines  Immunotherapeutics
Downloadedby[88.7.7.207]at22:5824November2015
hospitals of the Valencia Regions public health system, which
covers 98% of the approximately 5 million population of the
region, for a 5-year period. Therefore, it is unlikely that a signifi-
cant proportion of the total cases of intussusception would have
been seen in private hospitals. Also, vaccines administered in all
public and some private health centers are recorded in SIV,
regardless of their inclusion in the official immunization sched-
ule. A recent study has shown that, among all rotavirus vaccine
doses distributed during 2009–2012, most (86%) were registered
in SIV as administered in children aged less than one year.21
Nonetheless, because of these concerns, we chose a SCCS
approach restricted only to vaccinated cases. This method implic-
itly controls for time-fixed confounders, and, because of the
restriction to vaccinees, also minimizes potential misclassification
bias, and eliminates the need to address the healthy vaccinee
effect and the contraindication to vaccination issue found in
some studies. An additional strength of this study is that intussus-
ception diagnoses were confirmed through medical record review
of all potential cases hospitalized.
Our finding of an elevated intussusception risk point estimate
during the first week following administration of the first dose of
rotavirus vaccines was comparable in magnitude to estimates
from similar studies performed in the United States, Australia,
and Mexico.7-10
Despite having analyzed the whole population
of a large region for 5 years, our findings were not statistically sig-
nificant, maybe due to lack of study power. This is understand-
able given the rarity of intussusception and the low rotavirus
vaccine coverage in the region during the study period (full-
schedule coverage estimated for children aged under one year as
ranging between 24% to 49%, based on distributed vaccine
data). Because of the small size of the total vaccinated population,
and our need to evaluate rotavirus vaccine safety for the region
(regardless of specific vaccines used) both vaccines were evaluated
jointly. Our finding of very few vaccinated cases despite a thor-
ough multi-year investigation in a country which, according to
previous studies, may have a large background rate of intus-
susception,13,14
is reassuring, and provides information that
should contribute to deliberations about the need to include
rotavirus vaccines in the official Valencian and Spanish
calendars.
This study has also shown that a high quality investigation of
the safety of childhood vaccinations using Valencias healthcare
databases is possible. The high (93%) PPV found for a discharge
diagnosis of intussusception has opened the door to the imple-
mentation of a larger study without the need to perform medical
record reviews. Thus, we plan to continue the study for addi-
tional years, and invite also participation from other Spanish
regions. Moreover, following verification of the PPV of the dis-
charge diagnosis codes in candidate sites, the study could be
extended to include other European databases, thus gaining sub-
stantial power for the analysis of this rare event, even if vaccina-
tion coverage remains low. Such database integration will
substantially improve the capacity for timely post-licensure assess-
ments of the safety of any new vaccines introduced in Europe.
Disclosure of Potential Conflicts of Interest
SPV, JDD, and JPB are working at FISABIO-Public Health,
institution that has ongoing research contracts with GlaxoS-
mithKline Biologicals, Sanofi Pasteur MSD, and Merck  Co.,
Inc. JDD, JPB and RGP have received support for grants and
travel grants from GlaxoSmithKline Biologicals, Sanofi Pasteur
MSD, and Merck  Co., Inc. SPV has received travel grants for
Scientific Congress from GlaxoSmithKline Biologicals and Sanofi
Pasteur MSD. SR has no conflicts of interest.
Acknowledgments
Hector S. Izurieta, US Food and Drug Administration, for
advise in study design, analysis and review of the manuscript,
Martin Kulldorff, Harvard Medical School and Harvard Pilgrim
Health Care Institute, for advice regarding study methodology,
Marian Martın-Navarro and Monica Lopez-Lacort, FISABIO-
Public Health, for assistance in data collection and contributions
to the statistical analysis, respectively.
Authors’ Contributions
All authors contributed to the study design. SPV coordinated
the study, acquired the data, and review the cases. SPV, HSI and
Table 2. Risk estimates for confirmed intussusception cases after RotarixÒ
/RotaTeqÒ
vaccination, vaccinees-only SCCS approach
Vaccine dose
Risk period
(days post-vaccination)
Number
of cases
Non-risk period
(days post-vaccination)
Number
of cases
IRR (95% CI)
(crude)
IRR (95% CI)
(age-adjusted)
Dose 1
1–7 3 22–42 1 9.0 (0.9–86.5) 4.7 (0.3–74.1)
8–21 1 1.5 (0.1–24.0) 0.8 (0.1–13.9)
Dose 2
1–7 1 22–42 2 1.5 (0.1–16.5) 1.6 (0.1–32.3)
8–21 3 2.3 (0.4–13.5) 3.9 (0.3–44.0)
Dose 3
1–7 0 22–42 1 3.0 (0.2–48.0) Non interpretable1
8–21 0 Non interpretable1
Non interpretable1
*The observation period for each vaccine dose ends at day 42 post-vaccination.
1
Non-interpretable IRR due to very small numbers.
Abbreviations: Intussusception (IS); Confidence interval (CI).
www.tandfonline.com 1851Human Vaccines  Immunotherapeutics
Downloadedby[88.7.7.207]at22:5824November2015
SR analyzed the data. SPV drafted the manuscript. All authors
were involved in interpretation of the results, the critical revision
of drafts, and approved the final version of the manuscript.
Supplemental Material
Supplemental data for this article can be accessed on the
publisher’s website.
References
1. Rotarix: Product information. European Medicines
Agency, 2009
2. RotaTeq: Product information. European Medicines
Agency, 2008
3. Murphy TV, Gargiullo PM, Massoudi MS, Nelson
DB, Jumaan AO, Okoro CA, Zanardi LR, Setia S, Fair
E, LeBaron CW, et al. Intussusception among infants
given an oral rotavirus vaccine. N Eng J Med 2001;
344:564-72; PMID:11207352; http://dx.doi.org/
10.1056/NEJM200102223440804
4. Kramarz P, France EK, Destefano F, Black SB, Shine-
field H, Ward JI, et al. Population-based study of rota-
virus vaccination and intussusception. Pediat Infect Dis
J 2001; 20:410-6; PMID:11332666; http://dx.doi.org/
10.1097/00006454-200104000-00008
5. Vesikari T, Matson DO, Dennehy P, Van Damme P,
Santosham M, Rodriguez Z, Dallas MJ, Heyse JF, Goveia
MG, Black SB, et al. Safety and efficacy of a pentavalent
human-bovine (WC3) reassortant rotavirus vaccine. N
Eng J Med 2006; 354:23-33; PMID:16394299; http://
dx.doi.org/10.1056/NEJMoa052664
6. Ruiz-Palacios GM, Perez-Schael I, Velazquez FR, Abate
H, Breuer T, Clemens SC, Cheuvart B, Espinoza F,
Gillard P, Innis BL, et al. Safety and efficacy of an
attenuated vaccine against severe rotavirus gastroenteri-
tis. N Eng J Med 2006; 354:11-22; PMID:16394298;
http://dx.doi.org/10.1056/NEJMoa052434
7. Buttery JP, Danchin MH, Lee KJ, Carlin JB, McIntyre
PB, Elliott EJ, Booy R, Bines JE; PAEDS/APSU Study
Group. Intussusception following rotavirus vaccine
administration: post-marketing surveillance in the
National Immunization Program in Australia. Vaccine
2011; 29:3061-6; PMID:21316503; http://dx.doi.org/
10.1016/j.vaccine.2011.01.088
8. Carlin JB, Macartney KK, Lee KJ, Quinn HE, Buttery
J, Lopert R, Bines J, McIntyre PB. Intussusception risk
and disease prevention associated with rotavirus vac-
cines in Australia’s National Immunization Program.
Clin Infect Dis 2013; 57:1427-34; PMID:23964090;
http://dx.doi.org/10.1093/cid/cit520
9. Patel MM, Lopez-Collada VR, Bulhoes MM, De Oli-
veira LH, Bautista Marquez A, Flannery B, Esparza-
Aguilar M, Montenegro Renoiner EI, Luna-Cruz ME,
et al. Intussusception risk and health benefits of rotavi-
rus vaccination in Mexico and Brazil. N Eng J Med
2011; 364:2283-92; PMID:21675888; http://dx.doi.
org/10.1056/NEJMoa1012952
10. Yih WK, Lieu TA, Kulldorff M, Martin D, McMahill-
Walraven CN, Platt R, Selvam N, Selvan M, Lee GM,
Nguyen M. Intussusception risk after rotavirus vaccina-
tion in U.S. infants. N Eng J Med 2014; 370:503-12;
PMID:24422676
11. Bouzon Alejandro M, Diez Domingo J, Martinon-
Torres F. Circovirus and impact of temporary with-
drawal of rotavirus vaccines in Spain. Hum Vaccin
2011; 7:798-9; PMID:21715979; http://dx.doi.org/
10.4161/hv.7.7.15683
12. Jiang J, Jiang B, Parashar U, Nguyen T, Bines J, Patel
MM. Childhood intussusception: a literature review.
PLoS One 2013; 8:e68482; PMID:23894308; http://
dx.doi.org/10.1371/journal.pone.0068482
13. Bines JE, Ivanoff B. Acute intussusception in infants.
Incidence, clinical presentation and management: a
global perspective. Vaccines and Biologicals. Geneva:
World Health Organization, 2002
14. Bringue Espuny X, Ibars Valverde Z, Martinez Alonso
M, Morales Bara I, Sole Mir E. [Intestinal invagination:
change in its incidence from 1987 to 2008]. Cir Pediatr
2010; 23:206-10; PMID:21520551
15. Whitaker HJ, Farrington CP, Spiessens B, Musonda P.
Tutorial in biostatistics: the self-controlled case series
method. Stat Med 2006; 25:1768-97; PMID:16220518;
http://dx.doi.org/10.1002/sim.2302
16. Maclure M, Fireman B, Nelson JC, Hua W, Shoaibi A,
Paredes A, et al. When should case-only designs be
used for safety monitoring of medical products? Phar-
macoepidemiol Drug Safety 2012; 21 Suppl 1:50-61;
PMID:22262593; http://dx.doi.org/10.1002/pds.2330
17. Ministerio de Sanidad Servicios Sociales e Igualdad.
Explotacion del registro de altas CMBD del Sistema
Nacional de Salud. Spain, 2014.
18. Ministerio de Sanidad Servicios Sociales e Igualdad.
Informe Anual del Sistema Nacional de Salud 2011.
Spain, 2013.
19. Bines JE, Kohl KS, Forster J, Zanardi LR, Davis RL,
Hansen J, et al. Acute intussusception in infants and
children as an adverse event following immunization:
case definition and guidelines of data collection, analy-
sis, and presentation. Vaccine 2004; 22:569-74;
PMID:14741146; http://dx.doi.org/10.1016/j.vaccine.
2003.09.016
20. Pastor Villalba E, Martın-Ivorra R, Alguacil-Ramos
AM, Portero Alonso A, Barbera Catala MA, Pons
Sanchez C, Lluch Rodrigo JA. Sistema de Informacion
Vacunal (SIV). In: Generalitat Valenciana, Conselleria
de Sanitat, eds. Valencia (Spain) 2009.
21. Pastor-Villalba E, Martın-Ivorra R, Alguacil-Ramos
AM, Portero-Alonso A, Lluch Rodrigo J. [Exhaustivi-
dad en la declaracion en el sistema de informacion
vacunal (SIV) de vacunas no incluidas en el calendario
sistematico infantil de la Comunidad Valenciana. A~nos
2009 a 2012]. P04. 7th Congress of the Spanish Associ-
ation of Vaccinology. Caceres (Spain) 2013.
1852 Volume 11 Issue 7Human Vaccines  Immunotherapeutics
Downloadedby[88.7.7.207]at22:5824November2015

More Related Content

What's hot

Thesis-No-Show Project Bridgette-Noel Final
Thesis-No-Show Project Bridgette-Noel FinalThesis-No-Show Project Bridgette-Noel Final
Thesis-No-Show Project Bridgette-Noel Final
Brenda Bridgette-Noel
 

What's hot (20)

Covid 19 vaccine conversations 2021 01-20
Covid 19 vaccine conversations 2021 01-20Covid 19 vaccine conversations 2021 01-20
Covid 19 vaccine conversations 2021 01-20
 
How machine learning is used to find the covid 19 vaccine
How machine learning is used to find the covid 19 vaccineHow machine learning is used to find the covid 19 vaccine
How machine learning is used to find the covid 19 vaccine
 
Icc complaint-7
Icc complaint-7Icc complaint-7
Icc complaint-7
 
Covid 19 vaccine profit race
Covid 19 vaccine profit raceCovid 19 vaccine profit race
Covid 19 vaccine profit race
 
Vaccine Safety - A pediatrician perspective
Vaccine Safety - A pediatrician perspectiveVaccine Safety - A pediatrician perspective
Vaccine Safety - A pediatrician perspective
 
COVID-19 Vaccine: Answers to Your Questions
COVID-19 Vaccine: Answers to Your QuestionsCOVID-19 Vaccine: Answers to Your Questions
COVID-19 Vaccine: Answers to Your Questions
 
Serial real-time RT-PCR and serology measurements substantially improve Zika ...
Serial real-time RT-PCR and serology measurements substantially improve Zika ...Serial real-time RT-PCR and serology measurements substantially improve Zika ...
Serial real-time RT-PCR and serology measurements substantially improve Zika ...
 
COVID-19 Clinical Development
COVID-19 Clinical DevelopmentCOVID-19 Clinical Development
COVID-19 Clinical Development
 
The journal of law medicine ethics mapping
The journal of law medicine ethics mappingThe journal of law medicine ethics mapping
The journal of law medicine ethics mapping
 
Panel Discussion on the COVID Vaccine
Panel Discussion on the COVID VaccinePanel Discussion on the COVID Vaccine
Panel Discussion on the COVID Vaccine
 
Addressing Vaccine Hesitancy
Addressing Vaccine Hesitancy Addressing Vaccine Hesitancy
Addressing Vaccine Hesitancy
 
Thesis-No-Show Project Bridgette-Noel Final
Thesis-No-Show Project Bridgette-Noel FinalThesis-No-Show Project Bridgette-Noel Final
Thesis-No-Show Project Bridgette-Noel Final
 
COVID-19 Vaccine Deals
COVID-19 Vaccine DealsCOVID-19 Vaccine Deals
COVID-19 Vaccine Deals
 
“‘We have a lot of evidence that it’s a fake story all over the world’ – germ...
“‘We have a lot of evidence that it’s a fake story all over the world’ – germ...“‘We have a lot of evidence that it’s a fake story all over the world’ – germ...
“‘We have a lot of evidence that it’s a fake story all over the world’ – germ...
 
Pfizer's SARS-CoV-2 Vaccine Announcement
Pfizer's SARS-CoV-2 Vaccine AnnouncementPfizer's SARS-CoV-2 Vaccine Announcement
Pfizer's SARS-CoV-2 Vaccine Announcement
 
COVID-19 Vaccination Strategies for Youth
COVID-19 Vaccination Strategies for YouthCOVID-19 Vaccination Strategies for Youth
COVID-19 Vaccination Strategies for Youth
 
Clinical Trials: Phase 1/2 Highlights
Clinical Trials: Phase 1/2 HighlightsClinical Trials: Phase 1/2 Highlights
Clinical Trials: Phase 1/2 Highlights
 
Hawaii - Merck and Pfizer - Providing for Humanity - Research and Clinical Tr...
Hawaii - Merck and Pfizer - Providing for Humanity - Research and Clinical Tr...Hawaii - Merck and Pfizer - Providing for Humanity - Research and Clinical Tr...
Hawaii - Merck and Pfizer - Providing for Humanity - Research and Clinical Tr...
 
Update on COVID-19 Innovation: Detection and Vaccine
Update on COVID-19 Innovation: Detection and VaccineUpdate on COVID-19 Innovation: Detection and Vaccine
Update on COVID-19 Innovation: Detection and Vaccine
 
COVID-19 Vaccines, The Biological Weapons of Mass Destruction, by Igor Shephe...
COVID-19 Vaccines, The Biological Weapons of Mass Destruction, by Igor Shephe...COVID-19 Vaccines, The Biological Weapons of Mass Destruction, by Igor Shephe...
COVID-19 Vaccines, The Biological Weapons of Mass Destruction, by Igor Shephe...
 

Viewers also liked

Viewers also liked (15)

Listado para otorgar certificados
Listado para otorgar certificados Listado para otorgar certificados
Listado para otorgar certificados
 
Formato celdas
Formato celdasFormato celdas
Formato celdas
 
Tribute legends anushka_sharma
Tribute legends anushka_sharmaTribute legends anushka_sharma
Tribute legends anushka_sharma
 
La web-3....
La web-3....La web-3....
La web-3....
 
InfoHeaven - FEVEREIRO 2017
InfoHeaven - FEVEREIRO 2017InfoHeaven - FEVEREIRO 2017
InfoHeaven - FEVEREIRO 2017
 
Comparative superlative yolanda g
Comparative superlative yolanda gComparative superlative yolanda g
Comparative superlative yolanda g
 
Pontes com vão acima de 100m com viga metálica
Pontes com vão acima de 100m com viga metálicaPontes com vão acima de 100m com viga metálica
Pontes com vão acima de 100m com viga metálica
 
201728 22259 manual_picgenios
201728 22259 manual_picgenios201728 22259 manual_picgenios
201728 22259 manual_picgenios
 
CICLOMOBILIDADE: A EXPERIÊNCIA HOLANDESA; IDEIAS SUSTENTÁVEIS E INOVADORAS
CICLOMOBILIDADE: A EXPERIÊNCIA HOLANDESA; IDEIAS SUSTENTÁVEIS E INOVADORASCICLOMOBILIDADE: A EXPERIÊNCIA HOLANDESA; IDEIAS SUSTENTÁVEIS E INOVADORAS
CICLOMOBILIDADE: A EXPERIÊNCIA HOLANDESA; IDEIAS SUSTENTÁVEIS E INOVADORAS
 
Manual MH9 CO2 MCOHOME
Manual MH9 CO2 MCOHOMEManual MH9 CO2 MCOHOME
Manual MH9 CO2 MCOHOME
 
Neumonías
NeumoníasNeumonías
Neumonías
 
Apresentacao psicologia
Apresentacao psicologiaApresentacao psicologia
Apresentacao psicologia
 
Aeon labs zw130 wall mote quad instructions
Aeon labs zw130 wall mote quad instructionsAeon labs zw130 wall mote quad instructions
Aeon labs zw130 wall mote quad instructions
 
DERMATITIS
DERMATITISDERMATITIS
DERMATITIS
 
Chls470 2017
Chls470 2017Chls470 2017
Chls470 2017
 

Similar to Perez vilar 2015 (2)

Vaccine-surveillance-report-week-42.pdf
Vaccine-surveillance-report-week-42.pdfVaccine-surveillance-report-week-42.pdf
Vaccine-surveillance-report-week-42.pdf
Martin Hoffmann
 
Clinical Impact of Data From the CROI 2015,Seattle
Clinical Impact of Data From the CROI 2015,SeattleClinical Impact of Data From the CROI 2015,Seattle
Clinical Impact of Data From the CROI 2015,Seattle
Hivlife Info
 
Public Health Action Plan - HPV Vaccine
Public Health Action Plan - HPV VaccinePublic Health Action Plan - HPV Vaccine
Public Health Action Plan - HPV Vaccine
Tatanya Swan, MPH
 
Randomized trials of rrvtv vaccine a controversial issue
Randomized trials of rrvtv  vaccine        a  controversial issueRandomized trials of rrvtv  vaccine        a  controversial issue
Randomized trials of rrvtv vaccine a controversial issue
Xiomara Arias Fernandez
 

Similar to Perez vilar 2015 (2) (20)

Dr ahmad's presentation ( Vaccine Safety )
Dr ahmad's presentation ( Vaccine Safety )Dr ahmad's presentation ( Vaccine Safety )
Dr ahmad's presentation ( Vaccine Safety )
 
14 tlid1074 klein
14 tlid1074 klein14 tlid1074 klein
14 tlid1074 klein
 
Vaccine safety
Vaccine safetyVaccine safety
Vaccine safety
 
Rotavirus vaccine
Rotavirus vaccineRotavirus vaccine
Rotavirus vaccine
 
AIDSTAR-One Implementation of WHO's 2008 Pediatric HIV Treatment Guidelines
AIDSTAR-One Implementation of WHO's 2008 Pediatric HIV Treatment GuidelinesAIDSTAR-One Implementation of WHO's 2008 Pediatric HIV Treatment Guidelines
AIDSTAR-One Implementation of WHO's 2008 Pediatric HIV Treatment Guidelines
 
Bima oxford-az-vaccine-detailed-position-statement
Bima oxford-az-vaccine-detailed-position-statementBima oxford-az-vaccine-detailed-position-statement
Bima oxford-az-vaccine-detailed-position-statement
 
Vaccine-surveillance-report-week-42.pdf
Vaccine-surveillance-report-week-42.pdfVaccine-surveillance-report-week-42.pdf
Vaccine-surveillance-report-week-42.pdf
 
malaria.pptx
malaria.pptxmalaria.pptx
malaria.pptx
 
Clinical Impact of Data From the CROI 2015,Seattle
Clinical Impact of Data From the CROI 2015,SeattleClinical Impact of Data From the CROI 2015,Seattle
Clinical Impact of Data From the CROI 2015,Seattle
 
Clinical Impact of Data From the CROI 2015,Seattle
Clinical Impact of Data From the CROI 2015,SeattleClinical Impact of Data From the CROI 2015,Seattle
Clinical Impact of Data From the CROI 2015,Seattle
 
Zika Virus: An Emerging Arboviral Threat of 2016
Zika Virus: An Emerging Arboviral Threat of 2016Zika Virus: An Emerging Arboviral Threat of 2016
Zika Virus: An Emerging Arboviral Threat of 2016
 
Human Papillomavirus Immunization completion rates increased by the use of th...
Human Papillomavirus Immunization completion rates increased by the use of th...Human Papillomavirus Immunization completion rates increased by the use of th...
Human Papillomavirus Immunization completion rates increased by the use of th...
 
PharmaVoice: Malaria Research Update
PharmaVoice: Malaria Research UpdatePharmaVoice: Malaria Research Update
PharmaVoice: Malaria Research Update
 
Measles, Vaccines, Antibodies and Big Pharma Money
Measles, Vaccines, Antibodies and Big Pharma MoneyMeasles, Vaccines, Antibodies and Big Pharma Money
Measles, Vaccines, Antibodies and Big Pharma Money
 
Public Health Action Plan - HPV Vaccine
Public Health Action Plan - HPV VaccinePublic Health Action Plan - HPV Vaccine
Public Health Action Plan - HPV Vaccine
 
COVID-19 Developing Vaccinations & Therapeutic Drugs (Update: 15 October 2021)
COVID-19 Developing Vaccinations & Therapeutic Drugs (Update: 15 October 2021)COVID-19 Developing Vaccinations & Therapeutic Drugs (Update: 15 October 2021)
COVID-19 Developing Vaccinations & Therapeutic Drugs (Update: 15 October 2021)
 
Randomized trials of rrvtv vaccine a controversial issue
Randomized trials of rrvtv  vaccine        a  controversial issueRandomized trials of rrvtv  vaccine        a  controversial issue
Randomized trials of rrvtv vaccine a controversial issue
 
Comparison of immunity against canine distemper, adenovirus and parvovirus af...
Comparison of immunity against canine distemper, adenovirus and parvovirus af...Comparison of immunity against canine distemper, adenovirus and parvovirus af...
Comparison of immunity against canine distemper, adenovirus and parvovirus af...
 
ROTAVIRUS VACCINES IN INDIA .WHICH ONE WILL YOU CHOOSE AND WHY?
ROTAVIRUS VACCINES IN INDIA .WHICH ONE WILL YOU CHOOSE AND WHY?ROTAVIRUS VACCINES IN INDIA .WHICH ONE WILL YOU CHOOSE AND WHY?
ROTAVIRUS VACCINES IN INDIA .WHICH ONE WILL YOU CHOOSE AND WHY?
 
Vacunacion pvh
Vacunacion pvhVacunacion pvh
Vacunacion pvh
 

Recently uploaded

Dehradun Call Girls Service {8854095900} ❤️VVIP ROCKY Call Girl in Dehradun U...
Dehradun Call Girls Service {8854095900} ❤️VVIP ROCKY Call Girl in Dehradun U...Dehradun Call Girls Service {8854095900} ❤️VVIP ROCKY Call Girl in Dehradun U...
Dehradun Call Girls Service {8854095900} ❤️VVIP ROCKY Call Girl in Dehradun U...
Sheetaleventcompany
 
💚Call Girls In Amritsar 💯Anvi 📲🔝8725944379🔝Amritsar Call Girl No💰Advance Cash...
💚Call Girls In Amritsar 💯Anvi 📲🔝8725944379🔝Amritsar Call Girl No💰Advance Cash...💚Call Girls In Amritsar 💯Anvi 📲🔝8725944379🔝Amritsar Call Girl No💰Advance Cash...
💚Call Girls In Amritsar 💯Anvi 📲🔝8725944379🔝Amritsar Call Girl No💰Advance Cash...
Sheetaleventcompany
 
Russian Call Girls Lucknow Just Call 👉👉7877925207 Top Class Call Girl Service...
Russian Call Girls Lucknow Just Call 👉👉7877925207 Top Class Call Girl Service...Russian Call Girls Lucknow Just Call 👉👉7877925207 Top Class Call Girl Service...
Russian Call Girls Lucknow Just Call 👉👉7877925207 Top Class Call Girl Service...
adilkhan87451
 
Call Girls in Gagan Vihar (delhi) call me [🔝 9953056974 🔝] escort service 24X7
Call Girls in Gagan Vihar (delhi) call me [🔝  9953056974 🔝] escort service 24X7Call Girls in Gagan Vihar (delhi) call me [🔝  9953056974 🔝] escort service 24X7
Call Girls in Gagan Vihar (delhi) call me [🔝 9953056974 🔝] escort service 24X7
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 

Recently uploaded (20)

Call Girls Amritsar Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Amritsar Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Amritsar Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Amritsar Just Call 8250077686 Top Class Call Girl Service Available
 
Top Rated Hyderabad Call Girls Erragadda ⟟ 9332606886 ⟟ Call Me For Genuine ...
Top Rated  Hyderabad Call Girls Erragadda ⟟ 9332606886 ⟟ Call Me For Genuine ...Top Rated  Hyderabad Call Girls Erragadda ⟟ 9332606886 ⟟ Call Me For Genuine ...
Top Rated Hyderabad Call Girls Erragadda ⟟ 9332606886 ⟟ Call Me For Genuine ...
 
Dehradun Call Girls Service {8854095900} ❤️VVIP ROCKY Call Girl in Dehradun U...
Dehradun Call Girls Service {8854095900} ❤️VVIP ROCKY Call Girl in Dehradun U...Dehradun Call Girls Service {8854095900} ❤️VVIP ROCKY Call Girl in Dehradun U...
Dehradun Call Girls Service {8854095900} ❤️VVIP ROCKY Call Girl in Dehradun U...
 
Call Girls Madurai Just Call 9630942363 Top Class Call Girl Service Available
Call Girls Madurai Just Call 9630942363 Top Class Call Girl Service AvailableCall Girls Madurai Just Call 9630942363 Top Class Call Girl Service Available
Call Girls Madurai Just Call 9630942363 Top Class Call Girl Service Available
 
Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service AvailableCall Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
Call Girls Ahmedabad Just Call 9630942363 Top Class Call Girl Service Available
 
Models Call Girls In Hyderabad 9630942363 Hyderabad Call Girl & Hyderabad Esc...
Models Call Girls In Hyderabad 9630942363 Hyderabad Call Girl & Hyderabad Esc...Models Call Girls In Hyderabad 9630942363 Hyderabad Call Girl & Hyderabad Esc...
Models Call Girls In Hyderabad 9630942363 Hyderabad Call Girl & Hyderabad Esc...
 
Call Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Hyderabad Just Call 8250077686 Top Class Call Girl Service Available
 
💚Call Girls In Amritsar 💯Anvi 📲🔝8725944379🔝Amritsar Call Girl No💰Advance Cash...
💚Call Girls In Amritsar 💯Anvi 📲🔝8725944379🔝Amritsar Call Girl No💰Advance Cash...💚Call Girls In Amritsar 💯Anvi 📲🔝8725944379🔝Amritsar Call Girl No💰Advance Cash...
💚Call Girls In Amritsar 💯Anvi 📲🔝8725944379🔝Amritsar Call Girl No💰Advance Cash...
 
8980367676 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
8980367676 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad8980367676 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
8980367676 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
 
Russian Call Girls Lucknow Just Call 👉👉7877925207 Top Class Call Girl Service...
Russian Call Girls Lucknow Just Call 👉👉7877925207 Top Class Call Girl Service...Russian Call Girls Lucknow Just Call 👉👉7877925207 Top Class Call Girl Service...
Russian Call Girls Lucknow Just Call 👉👉7877925207 Top Class Call Girl Service...
 
Top Rated Hyderabad Call Girls Chintal ⟟ 9332606886 ⟟ Call Me For Genuine Se...
Top Rated  Hyderabad Call Girls Chintal ⟟ 9332606886 ⟟ Call Me For Genuine Se...Top Rated  Hyderabad Call Girls Chintal ⟟ 9332606886 ⟟ Call Me For Genuine Se...
Top Rated Hyderabad Call Girls Chintal ⟟ 9332606886 ⟟ Call Me For Genuine Se...
 
Premium Bangalore Call Girls Jigani Dail 6378878445 Escort Service For Hot Ma...
Premium Bangalore Call Girls Jigani Dail 6378878445 Escort Service For Hot Ma...Premium Bangalore Call Girls Jigani Dail 6378878445 Escort Service For Hot Ma...
Premium Bangalore Call Girls Jigani Dail 6378878445 Escort Service For Hot Ma...
 
Russian Call Girls Service Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
Russian Call Girls Service  Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...Russian Call Girls Service  Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
Russian Call Girls Service Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
 
Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...
Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...
Independent Call Girls In Jaipur { 8445551418 } ✔ ANIKA MEHTA ✔ Get High Prof...
 
Call Girls Mysore Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Mysore Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Mysore Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Mysore Just Call 8250077686 Top Class Call Girl Service Available
 
Call Girls Jaipur Just Call 9521753030 Top Class Call Girl Service Available
Call Girls Jaipur Just Call 9521753030 Top Class Call Girl Service AvailableCall Girls Jaipur Just Call 9521753030 Top Class Call Girl Service Available
Call Girls Jaipur Just Call 9521753030 Top Class Call Girl Service Available
 
Most Beautiful Call Girl in Bangalore Contact on Whatsapp
Most Beautiful Call Girl in Bangalore Contact on WhatsappMost Beautiful Call Girl in Bangalore Contact on Whatsapp
Most Beautiful Call Girl in Bangalore Contact on Whatsapp
 
Call Girls in Gagan Vihar (delhi) call me [🔝 9953056974 🔝] escort service 24X7
Call Girls in Gagan Vihar (delhi) call me [🔝  9953056974 🔝] escort service 24X7Call Girls in Gagan Vihar (delhi) call me [🔝  9953056974 🔝] escort service 24X7
Call Girls in Gagan Vihar (delhi) call me [🔝 9953056974 🔝] escort service 24X7
 
Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...
Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...
Saket * Call Girls in Delhi - Phone 9711199012 Escorts Service at 6k to 50k a...
 
Call Girls Service Jaipur {8445551418} ❤️VVIP BHAWNA Call Girl in Jaipur Raja...
Call Girls Service Jaipur {8445551418} ❤️VVIP BHAWNA Call Girl in Jaipur Raja...Call Girls Service Jaipur {8445551418} ❤️VVIP BHAWNA Call Girl in Jaipur Raja...
Call Girls Service Jaipur {8445551418} ❤️VVIP BHAWNA Call Girl in Jaipur Raja...
 

Perez vilar 2015 (2)

  • 1. Full Terms & Conditions of access and use can be found at http://www.tandfonline.com/action/journalInformation?journalCode=khvi20 Download by: [88.7.7.207] Date: 24 November 2015, At: 22:58 Human Vaccines & Immunotherapeutics ISSN: 2164-5515 (Print) 2164-554X (Online) Journal homepage: http://www.tandfonline.com/loi/khvi20 Intussusception following rotavirus vaccination in the Valencia Region, Spain Silvia Pérez-Vilar, Javier Díez-Domingo, Joan Puig-Barberà, Ruth Gil-Prieto & Silvana Romio To cite this article: Silvia Pérez-Vilar, Javier Díez-Domingo, Joan Puig-Barberà, Ruth Gil- Prieto & Silvana Romio (2015) Intussusception following rotavirus vaccination in the Valencia Region, Spain, Human Vaccines & Immunotherapeutics, 11:7, 1848-1852, DOI: 10.1080/21645515.2015.1049787 To link to this article: http://dx.doi.org/10.1080/21645515.2015.1049787 © 2015 The Author(s). Published with license by Taylor and Francis Group, LLC© Silvia Pérez-Vilar, Javier Díez-Domingo, Joan Puig-Barberà, Ruth Gil-Prieto, and Silvana Romio View supplementary material Accepted author version posted online: 17 Jun 2015. Submit your article to this journal Article views: 149 View related articles View Crossmark data
  • 2. Intussusception following rotavirus vaccination in the Valencia Region, Spain Silvia Perez-Vilar1,2,*, Javier Díez-Domingo1,3 , Joan Puig-Barbera1 , Ruth Gil-Prieto4 , and Silvana Romio2,5 1 Vaccine Research Fundacion para el Fomento de la Investigacion Sanitaria y Biomedica de la Comunitat Valenciana; FISABIO-Public Health; Valencia, Spain; 2 Department of Medical Informatics; Erasmus University Medical Center; Rotterdam, The Netherlands; 3 Facultad de Medicina; Universidad Catolica de Valencia “San Vicente Martir; Valencia, Spain; 4 Area of Preventive Medicine and Public Health; Rey Juan Carlos University; Madrid, Spain; 5 Department of Statistics and Quantitative Methods; Division of Biostatistics; Epidemiology and Public Health; Laboratory of Healthcare Research and Pharmacoepidemiology; University of Milano-Bicocca; Milan, Italy Keywords: intussusception, positive predictive value, rotavirus vaccines, self-controlled case-series (SCCS) method, vaccine safety Abbreviations: CI, Confidence Interval; CMBD, Spanish hospital discharge database; IRRs, Incidence Rate Ratios; PPV, Positive Predictive Value; RV1, RotarixÒ (GlaxoSmithKline Biologicals Rixensart Belgium); RV5, RotaTeqÒ (Merck Co. Inc. West Point PA USA); SCCS, Self-Controlled Case Series; SIV, Valencias Vaccine Information System Studies have shown high intussusception rates in Spain. We performed a hospital-based retrospective observational study of the intussusception risk following rotavirus vaccinations among infants in Valencia, a region of Spain with an annual birth cohort of approximately 48,000 children, during 2007–2011, using a self-controlled case series design. We performed medical record review of all cases using Brighton Collaborations case definition and assessed the positive predictive value (PPV) of the intussusception diagnosis code. Among 151 hospitalized cases discharged as intussusception, we confirmed 136 as Brighton Collaboration’s Levels 1 or 2, resulting in a PPV of 93% (95% CI: 87%–96%). Three confirmed cases occurred within days 1–7 following the first rotavirus vaccination. The incidence rate ratio was 9.0 (95% CI: 0.9–86.5) (crude) and 4.7 (95% CI:0.3–74.1)(age adjusted). In this first study in Europe, the intussusception risk point estimate was comparable to other studies, although results were not statistically significant, maybe due to limited power. The high PPV found will facilitate implementation of a larger study without requiring medical record review. Our finding of very few vaccinated cases despite a thorough 5-year investigation in a country that, according to previous studies, may have a large background rate of intussusception is reassuring and should contribute to deliberations about the need to include rotavirus vaccines in the official Spanish calendars. Manuscript Two oral live-attenuated rotavirus vaccines are currently available in the global market: a monovalent human vaccine, RotarixÒ (Glax- oSmithKline Biologicals, Rixensart, Belgium), indicated as a 2-dose series in infants between the ages of 6–12 and 24 weeks,1 and a pen- tavalent bovine-human reassortant vaccine, RotaTeqÒ (Merck Co., Inc., West Point, PA, USA), indicated as a 3-dose series starting at age 6–12 weeks and ending at age 32 weeks.2 Previously, an observed association between RotashieldÒ , the first licensed rotavirus vaccine, and intussusception, caused its withdrawal from the US market in 1999, only 9 months after licensure.3,4 The pre-licensure clinical trials for both RotarixÒ (RV1) and RotaTeqÒ (RV5), designed to exclude an association with intussusception of similar magnitude than that found for RotashieldÒ , did not find an associa- tion.5,6 However, after licensure, an increased risk, although of much lower magnitude, was found with both vaccines in Australia, Mexico, Brazil, and the United States.7-10 Both vaccines, RV1 and RV5, have been available in Spain since August 2006 and January 2007, respectively. Rotavirus vac- cines in Spain are not funded by the National Health System, but are recommended by scientific societies and most pediatri- cians, and paid for by parents. Due to the incidental finding of circovirus DNA contamination affecting both vaccines, the Span- ish Medicines Agency suspended RV5 distribution during June- November 2010, and RV1 distribution since March 2010.11 As of this publication, RV1 remains suspended in Spain. Intussusception risk varies across population and regions,12 and some studies have shown high background rates of intussus- ception in Spain;13,14 a potential association with rotavirus vacci- nation could cause concern. Thus, our aim was to investigate such association in the Valencia Region, Spain. © Silvia Perez-Vilar, Javier Díez-Domingo, Joan Puig-Barbera, Ruth Gil-Prieto, and Silvana Romio *Correspondence to: Silvia Perez-Vilar; Email: perez_silvil@gva.es Submitted: 02/24/2015; Revised: 04/19/2015; Accepted: 05/06/2015 http://dx.doi.org/10.1080/21645515.2015.1049787 This is an Open Access article distributed under the terms of the Creative Commons Attribution-Non-Commercial License (http://creativecommons.org/licenses/ by-nc/3.0/), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. The moral rights of the named author(s) have been asserted. 1848 Volume 11 Issue 7Human Vaccines Immunotherapeutics Human Vaccines Immunotherapeutics 11:7, 1848--1852; July 2015; Published with license by Taylor Francis Group, LLC SHORT REPORT Downloadedby[88.7.7.207]at22:5824November2015
  • 3. We performed a hospital-based retrospective observational study during January 1, 2007 – December 31, 2011. Intussus- ception risk following rotavirus vaccinations was assessed using a self-controlled cases series (SCCS) design.15 The SCCS is a case- only design that uses individuals who had the event of interest during the study period; we applied the vaccinated cases only SCCS approach, which uses only subjects who were exposed to a rotavirus vaccine.16 Therefore, inference is done within individu- als, and time-fixed confounders are controlled implicitly by design. Unvaccinated individuals and individuals for which vacci- nation status is unknown are excluded. The observation period (follow-up person-time) for each individual is divided in predefined risk and non-risk periods based on exposure. Therefore, the event of interest falls either into a risk or a non- risk period.15 In our case, the risk periods were defined as days 1–7, and 8–21, post-vaccination, following each dose of any rota- virus vaccine. The comparison (non-risk) period was days 22–42 following each dose. The study included assessment of the posi- tive predictive value (PPV) of the intussusception code used in the Spanish hospital discharge database, CMBD.17 Almost all the Valencia Region population (98%) is covered by the public health system,18 and all users have a unique identi- fication number that allows linking all health care databases and all medical records. Potential intussusception cases among resident infants aged 6–42 weeks, irrespective of their rotavirus vaccination status, were identified from CMBD through the ICD-9-CM code 560.0 in any diagnosis position. A review of hospitalization and primary care medical records of all potential cases was carried out using the standardized Brighton Collaboration case definition for intus- susception (see the Table S1 showing the Brighton criteria in the Appendix).19 First intussusception episodes considered confirmed (Brighton Level 1-Level 2) were included in the analyses. In our study, the event date was the date of onset of symptoms. The exposure of interest was vaccination with any dose of rotavirus vaccines. Rotavirus vaccination status was obtained from the regional vaccine information system, SIV.20 Lack of information or inconsistencies were confirmed through phone consultation with parents and verbal verification of the informa- tion in the childs vaccination card. Dose-specific incidence rate ratios (IRRs), and their 95% con- fidence intervals (CI), were assessed to investigate the association between confirmed intussusception cases and rotavirus vaccines within the 2 predefined risk periods. The IRR is estimated by within-individual comparisons of the incidence of the event of interest in risk and control periods using person-time denomina- tors. Given the strong confounding effect of age, analyses were adjusted using, as reference, intussusception-hospitalized rates by age in unvaccinated Valencia Regions children during 2001–2011.10 Specific rates by age were estimated using data from CMBD and from the Spanish Statistical Office database (www. ine.es); the pattern was modeled using spline function (Fig. 1). The PPVs were assessed for the different categories of Brigh- ton Collaboration case classification: (1) Level 1, (2) Level 1-Level 2, and (3) Levels 1-Level 2-Level 3. They were stratified for discharge code position and calendar year. All statistical tests were 2-sided. Statistical significance was defined as p 0.05. Analyses were performed using Stata/SE 13.1 (StataCorp LP Texas, USA), R 3.0.3 (Foundation for Statis- tical Computing, Vienna, Austria), SAS 9.2 (SAS Institute, Inc.), and SAS macros developed by Bart Spiessens. The study was conducted according to the existing legislation including the Good Epidemiological Practices (CIOMS 2009), the Helsinki Declaration (Seoul 2008) and the Law 14/2007, of 3 July, on Biomedical Research, and was approved by the Ethics Research Committee of the Direccion General de Salud Publica/ Centro Superior de Investigacion en Salud Publica, which pro- vided a waiver to access personal information and contact parents. The Valencia Region has an annual birth cohort of around 48,000 infants among a total population of approximately 5,000,000 inhabitants. Within the population of interest, infants aged 6 to 42 weeks discharged from hospitals of the Valencia Regions public health system, 151 potential hospitalized-intus- susception cases were identified after having excluded duplicate episodes (children transferred to a reference hospital). Cases occurred in 147 infants, since 4 infants (3%) had a second epi- sode. Medical records were available for all cases. Among first episodes, 125 cases (85.0%) were classified as Level 1, 11 (7.5%) as Level 2, 2 (1.4%) as Level 3, 8 (5.4%) as Insufficient Evidence, and one case (0.7%) was discarded. Of 136 confirmed intussus- ception cases, 35 (26%) occurred in rotavirus-vaccinated children (Fig. 2). Among them, 14 (40%), and 21 (60%) had received RV1 and RV5, respectively. The PPV of the diagnosis code for hospitalized intussuscep- tion cases (any discharge diagnosis position) was 93% (95% CI: 87%–96%) for Level 1-Level 2 of diagnosis certainty. No differ- ences by discharge diagnosis position or by calendar year were found (Table 1). Figure 1. Intussusception-hospitalized rates by age in unvaccinated Valencia Regions children aged less than 12 months during 2001–2011. www.tandfonline.com 1849Human Vaccines Immunotherapeutics Downloadedby[88.7.7.207]at22:5824November2015
  • 4. Three intussusception cases occurred within days 1–7 follow- ing first dose of a rotavirus vaccine (two after RV1 and one after RV5) resulting in a crude IRR point estimate of 9.0 (95% CI: 0.9–86.5), and in an age-adjusted estimate of 4.7 (95% CI:0.3–74.1) within this risk window. The number of cases occurring within 1–7, 8–21, and 22–42 days following each dose, and dose-specific IRRs are shown in Table 2. In this first post-licensure analytical study of the intussuscep- tion risk following rotavirus vaccination in Europe, we investi- gated intussusception cases among infants discharged from all Figure 2. Flowchart of hospitalized-intussusception cases. Table 1. Positive predictive values according to The Brighton Collaboration case classification by discharge code position, and by calendar year Positive Predictive Values Cases n Level 1% (95% CI) Level 1- Level 2 % (95% CI) Level 1-Level 2-Level 3 % (95% CI) Discharge code position 1st 148 86.5 (79.9–91.5) 93.2 (87.9–96.7) 94.6 (89.6–97.6) 1st or 2nd 149 86.6 (80.0–91.6) 93.3 (88.0–96.7) 94.6 (89.7–97.7) Any 151 85.4 (78.8–90.6) 92.7 (87.3–96.3) 94.0 (89.0–97.2) Calendar year1 2007 44 81.8 (67.3–91.8) 90.9 (78.3–97.5) 95.5 (84.5–99.4) 2008 30 86.7 (69.3–96.2) 93.3 (77.9–99.2) 93.3 (77.9–99.2) 2009 25 84.0 (63.9–95.5) 92.0 (74.0–99.0) 92.0 (74.0–99.0) 2010 28 89.3 (71.8–97.7) 92.9 (76.5–99.1) 92.9 (76.5–99.1) 2011 24 87.5 (67.6–97.3) 95.8 (78.9–99.9) 95.8 (78.9–99.9) 1 Any diagnosis position. Abbreviations: Positive Predictive Value (PPV); Confidence interval (CI). 1850 Volume 11 Issue 7Human Vaccines Immunotherapeutics Downloadedby[88.7.7.207]at22:5824November2015
  • 5. hospitals of the Valencia Regions public health system, which covers 98% of the approximately 5 million population of the region, for a 5-year period. Therefore, it is unlikely that a signifi- cant proportion of the total cases of intussusception would have been seen in private hospitals. Also, vaccines administered in all public and some private health centers are recorded in SIV, regardless of their inclusion in the official immunization sched- ule. A recent study has shown that, among all rotavirus vaccine doses distributed during 2009–2012, most (86%) were registered in SIV as administered in children aged less than one year.21 Nonetheless, because of these concerns, we chose a SCCS approach restricted only to vaccinated cases. This method implic- itly controls for time-fixed confounders, and, because of the restriction to vaccinees, also minimizes potential misclassification bias, and eliminates the need to address the healthy vaccinee effect and the contraindication to vaccination issue found in some studies. An additional strength of this study is that intussus- ception diagnoses were confirmed through medical record review of all potential cases hospitalized. Our finding of an elevated intussusception risk point estimate during the first week following administration of the first dose of rotavirus vaccines was comparable in magnitude to estimates from similar studies performed in the United States, Australia, and Mexico.7-10 Despite having analyzed the whole population of a large region for 5 years, our findings were not statistically sig- nificant, maybe due to lack of study power. This is understand- able given the rarity of intussusception and the low rotavirus vaccine coverage in the region during the study period (full- schedule coverage estimated for children aged under one year as ranging between 24% to 49%, based on distributed vaccine data). Because of the small size of the total vaccinated population, and our need to evaluate rotavirus vaccine safety for the region (regardless of specific vaccines used) both vaccines were evaluated jointly. Our finding of very few vaccinated cases despite a thor- ough multi-year investigation in a country which, according to previous studies, may have a large background rate of intus- susception,13,14 is reassuring, and provides information that should contribute to deliberations about the need to include rotavirus vaccines in the official Valencian and Spanish calendars. This study has also shown that a high quality investigation of the safety of childhood vaccinations using Valencias healthcare databases is possible. The high (93%) PPV found for a discharge diagnosis of intussusception has opened the door to the imple- mentation of a larger study without the need to perform medical record reviews. Thus, we plan to continue the study for addi- tional years, and invite also participation from other Spanish regions. Moreover, following verification of the PPV of the dis- charge diagnosis codes in candidate sites, the study could be extended to include other European databases, thus gaining sub- stantial power for the analysis of this rare event, even if vaccina- tion coverage remains low. Such database integration will substantially improve the capacity for timely post-licensure assess- ments of the safety of any new vaccines introduced in Europe. Disclosure of Potential Conflicts of Interest SPV, JDD, and JPB are working at FISABIO-Public Health, institution that has ongoing research contracts with GlaxoS- mithKline Biologicals, Sanofi Pasteur MSD, and Merck Co., Inc. JDD, JPB and RGP have received support for grants and travel grants from GlaxoSmithKline Biologicals, Sanofi Pasteur MSD, and Merck Co., Inc. SPV has received travel grants for Scientific Congress from GlaxoSmithKline Biologicals and Sanofi Pasteur MSD. SR has no conflicts of interest. Acknowledgments Hector S. Izurieta, US Food and Drug Administration, for advise in study design, analysis and review of the manuscript, Martin Kulldorff, Harvard Medical School and Harvard Pilgrim Health Care Institute, for advice regarding study methodology, Marian Martın-Navarro and Monica Lopez-Lacort, FISABIO- Public Health, for assistance in data collection and contributions to the statistical analysis, respectively. Authors’ Contributions All authors contributed to the study design. SPV coordinated the study, acquired the data, and review the cases. SPV, HSI and Table 2. Risk estimates for confirmed intussusception cases after RotarixÒ /RotaTeqÒ vaccination, vaccinees-only SCCS approach Vaccine dose Risk period (days post-vaccination) Number of cases Non-risk period (days post-vaccination) Number of cases IRR (95% CI) (crude) IRR (95% CI) (age-adjusted) Dose 1 1–7 3 22–42 1 9.0 (0.9–86.5) 4.7 (0.3–74.1) 8–21 1 1.5 (0.1–24.0) 0.8 (0.1–13.9) Dose 2 1–7 1 22–42 2 1.5 (0.1–16.5) 1.6 (0.1–32.3) 8–21 3 2.3 (0.4–13.5) 3.9 (0.3–44.0) Dose 3 1–7 0 22–42 1 3.0 (0.2–48.0) Non interpretable1 8–21 0 Non interpretable1 Non interpretable1 *The observation period for each vaccine dose ends at day 42 post-vaccination. 1 Non-interpretable IRR due to very small numbers. Abbreviations: Intussusception (IS); Confidence interval (CI). www.tandfonline.com 1851Human Vaccines Immunotherapeutics Downloadedby[88.7.7.207]at22:5824November2015
  • 6. SR analyzed the data. SPV drafted the manuscript. All authors were involved in interpretation of the results, the critical revision of drafts, and approved the final version of the manuscript. Supplemental Material Supplemental data for this article can be accessed on the publisher’s website. References 1. Rotarix: Product information. European Medicines Agency, 2009 2. RotaTeq: Product information. European Medicines Agency, 2008 3. Murphy TV, Gargiullo PM, Massoudi MS, Nelson DB, Jumaan AO, Okoro CA, Zanardi LR, Setia S, Fair E, LeBaron CW, et al. Intussusception among infants given an oral rotavirus vaccine. N Eng J Med 2001; 344:564-72; PMID:11207352; http://dx.doi.org/ 10.1056/NEJM200102223440804 4. Kramarz P, France EK, Destefano F, Black SB, Shine- field H, Ward JI, et al. Population-based study of rota- virus vaccination and intussusception. Pediat Infect Dis J 2001; 20:410-6; PMID:11332666; http://dx.doi.org/ 10.1097/00006454-200104000-00008 5. Vesikari T, Matson DO, Dennehy P, Van Damme P, Santosham M, Rodriguez Z, Dallas MJ, Heyse JF, Goveia MG, Black SB, et al. Safety and efficacy of a pentavalent human-bovine (WC3) reassortant rotavirus vaccine. N Eng J Med 2006; 354:23-33; PMID:16394299; http:// dx.doi.org/10.1056/NEJMoa052664 6. Ruiz-Palacios GM, Perez-Schael I, Velazquez FR, Abate H, Breuer T, Clemens SC, Cheuvart B, Espinoza F, Gillard P, Innis BL, et al. Safety and efficacy of an attenuated vaccine against severe rotavirus gastroenteri- tis. N Eng J Med 2006; 354:11-22; PMID:16394298; http://dx.doi.org/10.1056/NEJMoa052434 7. Buttery JP, Danchin MH, Lee KJ, Carlin JB, McIntyre PB, Elliott EJ, Booy R, Bines JE; PAEDS/APSU Study Group. Intussusception following rotavirus vaccine administration: post-marketing surveillance in the National Immunization Program in Australia. Vaccine 2011; 29:3061-6; PMID:21316503; http://dx.doi.org/ 10.1016/j.vaccine.2011.01.088 8. Carlin JB, Macartney KK, Lee KJ, Quinn HE, Buttery J, Lopert R, Bines J, McIntyre PB. Intussusception risk and disease prevention associated with rotavirus vac- cines in Australia’s National Immunization Program. Clin Infect Dis 2013; 57:1427-34; PMID:23964090; http://dx.doi.org/10.1093/cid/cit520 9. Patel MM, Lopez-Collada VR, Bulhoes MM, De Oli- veira LH, Bautista Marquez A, Flannery B, Esparza- Aguilar M, Montenegro Renoiner EI, Luna-Cruz ME, et al. Intussusception risk and health benefits of rotavi- rus vaccination in Mexico and Brazil. N Eng J Med 2011; 364:2283-92; PMID:21675888; http://dx.doi. org/10.1056/NEJMoa1012952 10. Yih WK, Lieu TA, Kulldorff M, Martin D, McMahill- Walraven CN, Platt R, Selvam N, Selvan M, Lee GM, Nguyen M. Intussusception risk after rotavirus vaccina- tion in U.S. infants. N Eng J Med 2014; 370:503-12; PMID:24422676 11. Bouzon Alejandro M, Diez Domingo J, Martinon- Torres F. Circovirus and impact of temporary with- drawal of rotavirus vaccines in Spain. Hum Vaccin 2011; 7:798-9; PMID:21715979; http://dx.doi.org/ 10.4161/hv.7.7.15683 12. Jiang J, Jiang B, Parashar U, Nguyen T, Bines J, Patel MM. Childhood intussusception: a literature review. PLoS One 2013; 8:e68482; PMID:23894308; http:// dx.doi.org/10.1371/journal.pone.0068482 13. Bines JE, Ivanoff B. Acute intussusception in infants. Incidence, clinical presentation and management: a global perspective. Vaccines and Biologicals. Geneva: World Health Organization, 2002 14. Bringue Espuny X, Ibars Valverde Z, Martinez Alonso M, Morales Bara I, Sole Mir E. [Intestinal invagination: change in its incidence from 1987 to 2008]. Cir Pediatr 2010; 23:206-10; PMID:21520551 15. Whitaker HJ, Farrington CP, Spiessens B, Musonda P. Tutorial in biostatistics: the self-controlled case series method. Stat Med 2006; 25:1768-97; PMID:16220518; http://dx.doi.org/10.1002/sim.2302 16. Maclure M, Fireman B, Nelson JC, Hua W, Shoaibi A, Paredes A, et al. When should case-only designs be used for safety monitoring of medical products? Phar- macoepidemiol Drug Safety 2012; 21 Suppl 1:50-61; PMID:22262593; http://dx.doi.org/10.1002/pds.2330 17. Ministerio de Sanidad Servicios Sociales e Igualdad. Explotacion del registro de altas CMBD del Sistema Nacional de Salud. Spain, 2014. 18. Ministerio de Sanidad Servicios Sociales e Igualdad. Informe Anual del Sistema Nacional de Salud 2011. Spain, 2013. 19. Bines JE, Kohl KS, Forster J, Zanardi LR, Davis RL, Hansen J, et al. Acute intussusception in infants and children as an adverse event following immunization: case definition and guidelines of data collection, analy- sis, and presentation. Vaccine 2004; 22:569-74; PMID:14741146; http://dx.doi.org/10.1016/j.vaccine. 2003.09.016 20. Pastor Villalba E, Martın-Ivorra R, Alguacil-Ramos AM, Portero Alonso A, Barbera Catala MA, Pons Sanchez C, Lluch Rodrigo JA. Sistema de Informacion Vacunal (SIV). In: Generalitat Valenciana, Conselleria de Sanitat, eds. Valencia (Spain) 2009. 21. Pastor-Villalba E, Martın-Ivorra R, Alguacil-Ramos AM, Portero-Alonso A, Lluch Rodrigo J. [Exhaustivi- dad en la declaracion en el sistema de informacion vacunal (SIV) de vacunas no incluidas en el calendario sistematico infantil de la Comunidad Valenciana. A~nos 2009 a 2012]. P04. 7th Congress of the Spanish Associ- ation of Vaccinology. Caceres (Spain) 2013. 1852 Volume 11 Issue 7Human Vaccines Immunotherapeutics Downloadedby[88.7.7.207]at22:5824November2015