What is this meeting all about?• Main goal: get feedback from the conference participants (you!) on what we should do better or different next year• Focus: the scientific content of the conference, not the logistics
New events this year• Should we keep them? Should we do them differently? – Outrageous ideas track – Minute madness – Meet the editors – Linked Data-a-thon – Future funding by EU and beyond• Ideas for special sessions for next year?
Tracks• Do we have too many tracks? Too few? – Research track – In-use track – Industry track• Do you know where you should submit?
Workshops and Tutorials• Balance different this year: more workshops (16), fewer tutorials (5)• Is this balance better than 50-50?• Ideas for workshops and tutorials next year – What would you like to see?
The Panels• 2 Panels this year – Meet Editors (Informational) – Deathmatch (Debate)• Do we want panels? – More or less? – What kind?
Events for students• How can we continue to increase the prestige of the Doctoral Consortium? Should we try?• Other events for students – Ideas?
Conference attendance• What makes it hard for people to attend the conference? (Please, limit to the things that we can change!) – Tight schedule? – Not enough venues to present something? – Other?
Outrageous Ideas Track• 24 Submissions• 5 selected by PC members for presentation• 19 available online for public vote• PC & Chairs• Criteria – Is the idea outrageous? – Is it something new? – Are the reasons it is outrageous made clear? – Are concrete use cases given? – Are the challenges to realizing the idea made clear? – Is this idea important for the development of our community?
Outrageous Ideas Stats (18p)• Challenges – 2.4 (0.58)• Importance to field – 2.2 (0.57)• Use cases – 2.1 (0.48)• Presentation of idea – 1.9 (0.58)• Outrageousness - 1.6 (0.73)• Novelty – 1.5 (0.66)
Reviews Process• Author provide title, keywords, abstract• Reviewers bid (primarily on title) – not all reviewers bid (and/or don’t indicate topics)• Author provide full papers – 1/3 abstracts are not submitted as full papers• Review assignment based on bids (3 rev. per paper)• Initial notification of authors & rebuttals• Reviews discussion and editing, considering rebuttals• Meta-reviews• Special Emergency Review Team (SERT)• SPC Meeting
Quality of Reviews• Consistency problems between reviewers – Numerical scoring – Review quality• Rebuttal consideration• Summer period – Late reviews – Participation in discussion• Proactiveness in SPC members – Meta-reviews not always reflect all three reviews – Comments not integrated in meta-reviews – Chasing missing reviews• Maybe a reviewer training program? – Quantitatively the same outcome
Rebuttals– Useful?– Infuriating?– Your thoughts as an author?– Your thoughts as a reviewer?– Should other tracks (in-use) have it?
SWSA 10-Year Award• We used Google Scholar citations for papers from SWWS 2001 + sanity check• There is no perfect way to assess impact• Is there a better proxy than citation counts? What is it? Does it need to be “objective”?
What’s anInfluential Paper?what metadata dowe need toidentify reliablyinfluential papers?
Top cited papers from 2001 SWWS• 338: Anupriya Ankolekar, Mark H. Burstein, Jerry R. Hobbs, Ora Lassila, David L. Martin, Sheila A. McIlraith, Srini Narayanan, Massimo Paolucci, Terry R. Payne, Katia P. Sycara, Honglei Zeng "DAML-S: Semantic Markup for Web Services"• 273: Harold Boley, Said Tabet, Gerd Wagner "Design Rationale for RuleML: A Markup Language for Semantic Web Rules”• 226: Diego Calvanese, Giuseppe De Giacomo, Maurizio Lenzerini "A Framework for Ontology Integration”• 225: Michel C. A. Klein, Dieter Fensel "Ontology versioning on the Semantic Web”• 220: Jane Hunter "Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology”
Past ISWC Best Papers• ISWC-2009: Chris Welty & Lora Aroyo: On the Semantic Web  Rank 30/53, max 43, 5 papers > 20.• ISWC-2008: Chris Welty & Lora Aroyo Large Data on the Semantic Web . Rank 3/57, max 70, 4 papers > 50.• ISWC-2007: Chris Welty & Lora Aroyo. Data on the Semantic Web • ISWC-2006: Chris Welty & Lora Aroyo. Queries on the Semantic Web . Rank 1/72, 6 papers > 100. bad data• ISWC-2005: Chris Welty & Lora Aroyo. Social Networks on the Semantic Web.  Rank 1/72, 8 papers>100. bad data• ISWC-2004: Chris Welty & Lora Aroyo. Knowledge Bases on the Semantic Web  Rank 8/54, max 489. 17 papers > 100.• ISWC-2003: Chris Welty & Lora Aroyo. Reasoning on the Semantic Web.  Rank 23/54, max 498. 20 papers>100• ISWC-2002: Chris Welty & Lora Aroyo. Ontologies on the Semantic Web.  Rank 23/41, max 1890. 12 papers > 100.
Past ISWC Best Papers• ISWC-2009: Ugur Kuter & Jennifer Golbeck: Semantic Web Service Composition in Social Environments  Rank 30/53, max 43, 5 papers > 20.• ISWC-2008: Matthew Horridge, Bijan Parsia & Ulrike Sattler for Laconic and Precise Justifications in OWL . Rank 3/57, max 70, 4 papers > 50.• ISWC-2007: Dimitris Zeginis, Yannis Tzitzikas and Vassilis Christophides. On the Foundations of Computing Deltas between RDF models • ISWC-2006: Marcelo Arenas, Jorge Perez and Claudio Gutierrez. Semantics and Complexity of SPARQL . Rank 1/72, 6 papers > 100. bad data• ISWC-2005: Peter Mika. Ontologies are us: A unified model of social networks and semantics.  Rank 1/72, 8 papers>100. bad data• ISWC-2004: Y. Guo, Z. Pan, and J. Heflin. An Evaluation of Knowledge Base Systems for Large OWL Datasets  Rank 8/54, max 489. 17 papers > 100.• ISWC-2003: Aimilia Magkanaraki, Val Tannen, Vassilis Christophides, Dimitris Plexousakis. Viewing the Semantic Web through RVL Lenses.  Rank 23/54, max 498. 20 papers>100• ISWC-2002: Peter F. Patel-Schneider, Jérôme Siméon. Building the Semantic Web on XML.  Rank 23/41, max 1890. 12 papers > 100.
What is SWSA?• Semantic Web Science Association (SWSA) – A committee of 12-15 members (iswsa.org) – Main role: manage the ISWC conference series • Decide on the location of each conference – Calls for bids are out ~2.5 years before the conference – Rotates location Americas/Europe/Asia-Pacific • Appoint and approve general chair and program chairs for the conference• If you have feedback on ISWC in general and ideas for future conferences, email email@example.com
Any other thoughts? Gripes?• What can we do better next year? Email to: firstname.lastname@example.org