Workshop Karlsruhe
From SWS Challenge Wiki
7th Semantic Web Services Challenge Workshop
Part of the 7th International Semantic Web Conference ISWC 2008
October 26-30, 2008
Kongresszentrum (Congress Center) in Karlsruhe, Germany
Here you will find the previous SWS-Challenges: SWS-Challenge
Contents |
Overview and Introduction
Research of Semantic Web Services has gained a lot of momentum over past few years, demonstrating its viability for dynamic service discovery, selection, composition, negotiation, mediation and invocation over the Web. However, design and development of Semantic Web Services tools and applications is still a new practice not only with the research community but also the industry. Software developers need to deal with new kinds of artifacts (e.g. semantic descriptions, ontologies, complex rules, formulas and facts), new kinds of operations (e.g. mapping, merging, transformation, querying and reasoning) and probably new kinds of user interactions and visualizations.
Best practices, methodologies and tools to help in dealing with these artifacts and operations in Semantic Web Services development are thus in high demand. Moreover, there are few scientific method of comparing and evaluating the strengths and weaknesses of functionalities claimed. Other than the SWS Challenge, there is no standard testbed to assess the robustness and applicability of proposed technologies to real world problem scenarios. Progress in scientific development and in industrial adoption in Service Oriented Architectures (SOAs) is thereby critically hindered.
The SWS Challenge initiative is specifically designed to develop a standard methodology and testbed for the evaluation of Semantic Web Services technologies. In addition to this this initiative, there is the associated W3C SWS Testbed Incubator which has issued a W3C Incubator Group Report about the evaluation methodology developed within the SWS Challenge.
This workshop, under the umbrella of the ISWC 2008 conference will provide a common platform for the researchers and developers of the Semantic Web Services to present and discuss the latest progress in the area, to identify the gap between the Semantic Web Services research and required methodologies, tools as well as the applications.
First, it will focus on finding out different ways, methodologies, tools and technologies for evaluation of Semantic Web Services tools and applications, continuing the work of the SWS Challenge, and the Incubator. Participants should be familiar with the previous work of these initiatives, including the Incubator Group Report above. Papers on this subject are highly welcome, and need not be accompanied by a Challenge solution to be evaluated.
Thus, participants are invited to discuss the Challenge's current evaluation methodology. Insights gained during the workshops will provide additional input to the W3C SWS Testbed Incubator Group which aims at standardizing an evaluation methodology for semantic web services technology.
Second, the workshop will continue the SWS Challenge which is an ongoing and continuous experiment in evaluating the functionality of SWS technologies. The curent set of evaluations are posted on this wiki and proposed solutions will follow the current evaluation methodology also available here. Participants are invited to propose new scenarios to be incorporated into the official SWS-Challenge testbed.
The activity most closely related to the SWS Challenge is the S3 Contest on Semantic Service Selection. However, the SWS Challenge and the S3 contest are working in different parts of the reseach space. The organizers agree that they are related and both should be explored. In fact, the cross-referencing between both events on their web sites and inter-linkage of other activities (e.g., common use of test services) has been agreed between organizers.
Topics of Interest
SWS Evaluation Methodolgy
- Methods to describe evaluation aspects and parameters
- Identification of resource consumption characteristics
- Models for describing and measuring in evaluation
- Techniques and formulas for evaluation
- Infrastructures and tools for evaluation
- Performance and scalability evaluations and benchmarks
- Integration of evaluation tools into frameworks
- Description of application of SWS technology in industry or on
- real world use cases and evaluation metrics
Semantic Web Services Challenge
- Descriptions of implemented solutions to any of the SWS-Challenge problem scenarios
- Proposals of new scenarios for evaluation
- Evaluation of surprise scenario variations
Target Audience
The Evaluation Methodology track of the workshop will address the researchers and practitioners working in the evaluation and benchmarking of Semantic Web Services technologies. It will also target the potential users to learn the feasibility of Semantic Web Services to be used in market and industry.
The actual Challenge Evaluation track will address the researchers and practitioners developing evaluation scenarios in context of Semantic Web Services challenge as well as building solutions for the given problem sets. The previous workshops have attracted not only people from the semantic web community in general, but also from the formal methods and software engineering community and from industrial research. The Challenge has thus succeeded to bridge communities working on different aspects in the field.
Workshop Program
The workshop requires two days. The 1st day will include the invited talk, presentations of accepted papers and panel discussion. The second day foucuses demonstration of the implemented scenarios and evaluation accordingly. Typically, participants will be asked to develop solutions to "surprise" variations of scenarios overnight and present solutions on the 2nd day. Solutions of the variations will be verified and the participants will show that their solutions can be reversed so that the original problem can still be solved. There will be a group examination and evaluation of the code and/or methods required to do this, according to the most current methodology.
Day 1: Track 1 - Evaluation of Semantic Web Services tools and applications
- 09:00 - 09:30 Welcome and Introduction
- 09:30 - 10:15 Invited Talk
- 10:15 - 10:30 Coffee Break
- 10:30 - 12:30 Paper Presentations
- 12:30 - 14:00 Lunch Break
- 14:00 - 16:00 Paper Presentations
- 16:00 - 16:15 Coffee Break
- 16:15 - 17:00 Panel Discussion
- 17:00 - 17:30 Conclusion for first day
Day 2: Track 2 - Semantic Web Services Challenge: Evaluation of Solutions
- 09:00 - 09:15 Welcome by Charles Petrie
- 09:15 - 09:45 Status, Plan and Evaluation Methodology by Michal Zaremba
- 09:45 - 10:15 Presentations and Demos
- 10:15 - 10:30 Coffee Break
- 10:30 - 12:30 Presentations and Demos
- 12:30 - 14:00 Lunch Break
- 14:00 - 16:00 Presentations and Demos
- 16:00 - 16:15 Coffee Break
- 16:15 - 17:00 Evaluation and Results
- 17:00 - 17:30 Closing
Organizing Committee
Scientific
- Charles Petrie, Logic Group at Stanford University (USA)
- Michal Zaremba, Semantic Technology Institute Innsbruck (AT)
- Emanuele Della Valle, CEFRIEL (IT)
- Ulrich Küster, Friedrich Schiller University Jena (DE)
- Tiziana Margaria, Computer Science Dept., U. Potsdam (DE)
Technical Support
- Omair Shafiq, Semantic Technology Institute Innsbruck (AT)
- Srdjan Komazec, Semantic Technology Institute Innsbruck (AT)
Program Committee
- Christoph Bussler, Merced Systems, Inc.
- Stefano Ceri, Politecnico di Milano
- Siobhán Clarke, Trinity College
- Oscar Corcho, Universidad Politecnica de Madrid, Spain
- John Domingue, KMI, Open University, UK
- Peter Emmel, SAP, Germany
- Fausto Giunchiglia, University of Trento, Italy
- Matthias Klusch, DFKI, Germany
- Thorsten Liebig, Ulm University, Germany
- David Martin, SRI, USA
- Malgorzata Mochól, Free University Berlin, Germany
- Axel Polleres, DERI Galway, Ireland
- Kavitha Srinivas, IBM Research, USA
- York Sure, SAP Research, Germany
- Tomas Vitvar, STI Innsbruck, Austria
- Alexander Wahler, STI International, Austria
- Jos de Bruijn, University of Bolzano, Italy
- Richard Waldinger, SRI, USA
- Baoshi Yan, Bosch (USA)
- Sudhir Agarwal, University of Karlsruhe, Germany
- Anupriya Ankolekar, HP Palo Alto, USA
Submission and Proceedings
Submissions are to be formatted according to the guidelines of the ISWC2008 conference (Springer LNCS style). The page limit for full papers is 10 pages, for SWS-Challenge solution papers two additional pages are accepted.
Papers describing SWS-Challenge solutions should describe the technology employed for the solution and focus on how that technology was actually used to solve the challenge problems. The reader should be able to understand a particular solution in theory and practice by reading a solution paper. Additional submission of the code and documentation of the solution is strongly encouraged.
Note that ISWC requires workshop attendees to also register for the main conference. So try to register both for the conference and the workshop before the ISWC2008 early registration deadline.
Since the ISWC does not include workshop proceedings, we intend to publish the workshop proceedings online at CEUR-WS. If the number of high-quality submissions is high enough, we will pursue publishing the proceedings as a journal special issue or as printed proceedings.
Guidelines for Paper Submission
Papers are to be submitted online via the SWSC-ISWC2008 EasyChair submission system.
In case of any further questions about submission process, contact Omair Shafiq (omair.shafiq@sti2.at).
Guidelines for Code Submission (only for SWS Challenge solution papers)
Interested participants should directly contact Srdjan Komazec (srdjan.komazec@sti2.at) to get an account for the SWS-Challenge FTP server (ftp://sws-challenge.org).
Important Dates
- Workshop CFP will be out: 2 May 2008
- Submissions due: 25 July 2008
- Acceptances: 5 September 2008
- Camera ready papers: 26 September 2008
- Camera ready proceedings: 03 October 2008
- Workshop dates: 26-27 October 2008 (to be confirmed)
Please do not hesitate to contact Charles Petrie for any questions you have!
