|
Size: 6260
Comment:
|
← Revision 126 as of 2012-06-22 07:45:46 ⇥
Size: 9068
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| = Third Answer Set Programming Competition - 2011 = | = Third (Open) Answer Set Programming Competition - 2011 = {{{#!wiki caution The Third Answer Set Programming Competition is now over: have a look at the [[https://www.mat.unical.it/aspcomp2013|4th ASP Competition]] site. }}} |
| Line 3: | Line 6: |
| ** UNDER CONSTRUCTION - THIS SITE WILL BE OFFICIALLY ANNOUNCED SOON ** | <<TableOfContents>> |
| Line 5: | Line 8: |
| Answer Set Programming is a well-established paradigm of declarative programming with close relationship with other declarative modelling paradigms and languages such as SAT Modulo Theories, Constraint Handling Rules, FO(.), PDDL and many others. |
== Current Status == * <<newicon>> Fix to outcomes of problem 22 (Hanoi Towers). Access results section in order to get new data. * Have a look at [[Pictures|some shots]] from LPNMR'11! * The Organizing Committee of the Third Answer Set Programming Competition, held at the [[http://www.mat.unical.it|Department of Mathematics]] of [[http://www.unical.it|University of Calabria]], is pleased to herald final results (publicly announced at [[https://sites.google.com/site/lpnmr11/ |LPNMR 2011]] - Vancouver, BC, Canada). And the winner is... well, have a look at the : [[SystemTrackFinalResults|System Track Official Results]] -- [[Model&SolveTrackFinalResults|Model & Solve Track Official Results]]. * Competition: * System Track: '''over'''. * Model & Solve Track: '''over'''. |
| Line 9: | Line 16: |
| Since the first informal editions (Dagstuhl 2002 and 2005), ASP systems compete in the nowadays customary ASP Competition: the Third ASP Competition will take place at the University of Calabria (Italy) in the first half of 2011. The event is the sequel to the ASP Competitions Series, held at the Universitaet Potsdam in Germany (2006-2007) and at the University of Leuven in Belgium in 2009. The current competition is held jointly with the 11th International Conference on Logic Programming and Nonmonotonic Reasoning ([[https://sites.google.com/site/lpnmr11/|LPNMR 11]]) where the results will be published. |
== Official Results == * [[SystemTrackFinalResults|System Track Official Results]] * [[Model&SolveTrackFinalResults|Model & Solve Track Official Results]]. |
| Line 15: | Line 20: |
| The formula of the event is open to ASP systems and any other system based on a declarative specification paradigm. Participant will compete on a selected collection of benchmark problems, declarative specifications and instances thereof. Before the application of competitor systems, there will be a problem selection stage, in which participants and interested researchers will be able to submit problem specifications; these will be then selected by the Organizing Committee, after an informal review and discussion stage. |
== Competition Stuff - Quick directions == * Results: for both [[SystemTrackFinalResults|System]] and [[Model&SolveTrackFinalResults|Model & Solve]] tracks, outcomes and standings are provided on the overall, per each category, per each benchmark, and even on an instance-by-instance basis. * [[Participants|List of participants]], along with detailed info and ''run packages'' for the sake of reproducibility. * [[OfficialProblemSuite|Problem Suite]], featuring the benchmark problems participants compared on. Please find complete descriptions, encodings where available, complete set of instances, and much more. * Official [[#awards|Awards]]. * Info about the competition set-up: * [[#schedule|Important Dates]]. * [[CallforParticipation|Call for participation]]. * [[ParticipantSubmission|How to participate]]. |
| Line 18: | Line 30: |
| The Competition will be constituted by two different sub-competitions, conceived for fostering some equivalently important, yet orthogonal, aspects: the System Competition, held on the basis of a fixed problem specification, fixed standard ASP language, and the Model & Solve Competition, held on an open problem specification, open language basis, and open to any system based on a declarative specification paradigm. Given that the interest towards parallel ASP systems is legitimately increasing, we encourage the submission of parallel systems as non-competing participants to both the competition tracks. |
=== Reports and Slides === * The ''preliminary'' report of the '''System Track''', appeared in the Proceedings of LPNMR'11, is available [[http://dx.doi.org/10.1007/978-3-642-20895-9_46|HERE]]. * The slides of the talk given at [[https://sites.google.com/site/lpnmr11/ |LPNMR 2011]] - Vancouver, BC, Canada, are available [[attachment:calimeri-ianni-ricca-aspcomp-lpnmr-2011.pdf|HERE]] (PDF file). |
| Line 26: | Line 34: |
| In order to ensure an high-level of impartiality, the Universita' della Calabria team decided not to participate with an own system. | === Pictures === * Pictures: [[Pictures|some shots]] taken at [[https://sites.google.com/site/lpnmr11/ |LPNMR 2011]]. |
| Line 28: | Line 37: |
| == System Competition == | <<Anchor(awards)>> == Awards == The 3rd ASP competition is divided into two main sub-tracks (System Track and Model & Solve Track) and awards: * The winner of the System Track * The winner of the Model & Solve Track In both competition tracks, winners in the respective subcategories are awarded: |
| Line 30: | Line 44: |
| The System Competition is conceived for 1) fostering the introduction of a standard language for ASP, and the birth of a new working group for defining an official standard; 2) let the competitors compare each other in fixed conditions. |
<<Anchor(awards)>> === Model & Solve Track === * Winner of the P category (polynomial problems) * Winner of the NP category (NP-Hard problems) * Winner of the Beyond NP category (more-than-NP-Hard problems) * Optimization (Optimization problems) |
| Line 34: | Line 51: |
| In this track, problem encodings will be fixed for all participants: specialized solutions on a per problems basis are not allowed. Problems will be specified in the two languages ASP-Core and ASP-RFC. Rankings on the System competition should give a fairly objective measure of what one can expect when switching from a system to another, while keeping all other conditions fixed (problem encoding and default solver settings). |
=== System Track === * Winner of the P category (polynomial problems) * Winner of the NP category (NP-Hard problems) * Winner of the Beyond NP category (more-than-NP-Hard problems) |
| Line 42: | Line 56: |
| === Standard Languages === | <<Anchor(detailed)>> == Detailed Information == * Competition Categories * [[MSCompetition|Model & Solve Competition]] * [[SystemCompetition|System Competition]] * [[ParticipationRules|Scoring and Participation Rules]] * [[http://www.mat.unical.it/aspcomp2011/files/LanguageSpecifications-1.20.pdf|File and language format specifications]] (v. 1.20) * [[http://www.mat.unical.it/aspcomp2011/files/LanguageSpecifications-1.11.pdf|File and language format specifications]] (v. 1.11) * [[http://www.mat.unical.it/aspcomp2011/files/LanguageSpecifications-1.10.pdf|File and language format specifications]] (v. 1.10) * [[http://www.mat.unical.it/aspcomp2011/files/LanguageSpecifications-1.01.pdf|File and language format specifications]] (v. 1.01) * [[http://www.mat.unical.it/aspcomp2011/files/LanguageSpecifications-1.00.pdf|File and language format specifications]] (v. 1.00) * [[BenchmarkProblems|Benchmark problem classification]] * [[BenchmarkSubmission|Benchmark Submission procedure]] * [[ParticipantSubmission|Participant Submission procedure]] * [[NewsUpdates|News and Updates]] * [[ToolsUtilities|Tools and Utilities]] * Former competitions: * [[http://asparagus.cs.uni-potsdam.de/contest/|First]] ASP Competition * [[http://dtai.cs.kuleuven.be/events/ASP-competition/index.shtml|Second]] ASP Competition |
| Line 44: | Line 76: |
| ASP-Core is a conservative extension to the non-ground case of the SCore language adopted in the First ASP Competition; it complies with the core language draft specified at LPNMR 2004, and includes constructs which are nowadays common in current ASP parsers. ASP-Core includes: ground queries, disjunctive rules with negation as failure, strong negation and arithmetic builtins. Terms are constants and variables only. |
== News and updates == * June 09, 2011 - Fix to outcomes of problem 22 (Hanoi Towers). * May 18, 2011 - Results (announced at [[https://sites.google.com/site/lpnmr11/ |LPNMR 2011]] - Vancouver, BC, Canada) are available. And the winner is... well, have a look at the : [[SystemTrackFinalResults|System Track Official Results]] -- [[Model&SolveTrackFinalResults|Model & Solve Track Official Results]]. * May 18, 2011 - Complete [[Participants|list of participants]] available. * Mar 05, 2011 - Update [[http://www.mat.unical.it/aspcomp2011/files/LanguageSpecifications.pdf|file and language format specifications]]. Please have a look at the change log. * Feb 10, 2011. '''New Deadline extension for the Model & Solve track: March 15th, 2011.''' Note that ''the deadline for the System track does not change''. * Feb 4th, 2011. Detailed regulations on memory limits in the [[ParticipationRules|rules]] section. * Feb 1st, 2011. Added a clarification regarding randomized systems in the [[ParticipationRules|rules]] section. * Jan 28th, 2011. Added a [[https://dtai.cs.kuleuven.be/krr/software/visualisation|tool]] (from KU-Leuven KRR group) for graphically displaying problem solutions, in the [[https://www.mat.unical.it/aspcomp2011/ToolsUtilities|Tools & Utilities]] page. * Jan 26th, 2011. Modified [[http://www.mat.unical.it/aspcomp2011/files/LanguageSpecifications.pdf|file and language format specifications]]. Please have a look at the change log. * Jan 20th, 2011. [[https://www.mat.unical.it/aspcomp2011/ToolsUtilities|Shifter]] tool updated with enable syntax trasformation option (transforms '<>' into '!=', and 'v' into '|')! * Jan 18th, 2011. You can find in the [[OfficialProblemSuite|Official Problem Suite]] the final problem specifications (continously updated). Stay in touch! * Jan 10th, 2011. Modified [[http://www.mat.unical.it/aspcomp2011/files/LanguageSpecifications.pdf|file and language format specifications]]. Please have a look at the change log. * January 5th, 2011. Released a [[PreliminaryProblemList|preliminary problem list]]. |
| Line 50: | Line 91: |
| The ASP-RFC format comes in the form of a "Request for Comments" from the ASP community, and extends ASP-Core with non-ground queries, function symbols and a limited number of pre-defined aggregate functions. A limited number of problems specified in ASP-RFC will be selected for the System competition. We do expect the ASP-RFC format will foster discussion in the community and feed useful material to the foreseen forthcoming constitution of an ASP standard language working group. We understand that the semantics of aggregate atoms is currently subject of debate in the community: for the sake of the Competition, ASP-RFC programs are restricted to programs containing non-recursive aggregates. Other reasonable restriction apply for ensuring that integers and function symbols are finitely handled. |
You might want to [[https://www.mat.unical.it/aspcomp2011/FrontPage?action=subscribe|subscribe]] this page for getting e-mail notifications about news (needs [[https://www.mat.unical.it/aspcomp2011/FrontPage?action=login|opening]] an user account). |
| Line 62: | Line 95: |
| == Model and Solve Competition == | <<Anchor(schedule)>> == Important Dates == ~- * Problem selection stage: * December 31th, 2010 - Deadline for problem submission * January 3th, 2011 - Publication of temporary list of selected benchmarks * January 4-10th, 2011 - Submission of accepted benchmarks in finalized version * January 10th, 2011 - Publication of the final list of selected problems -~ |
| Line 64: | Line 105: |
| The Model & Solve Competition is conceived for | {{{#!wiki caution |
| Line 66: | Line 107: |
| (1) fostering existing relationships with communities neighbor to ASP; (2) encourage the development of new ASP constructs or entirely newly devised declarative programming paradigms; (3) let the partipants compete in an open language, open problem specification regime. |
* Competition stage schedule: * February 18th, 2011 - ''System Track Dry Run start''. '''THIS IS NOT THE FINAL DEADLINE''' (See [[#notesOnDryRuns|notes below]]). * February 25th, 2011, 23:59 Pacific Standard Time - '''Final''' deadline for Competitors Submission '''to System Competition Track'''. * February 26th, 2011 - Start of the unmanned official competition run of the System Track. * March 08th, 2011 - ''Model & Solve Dry Run start''. '''THIS IS NOT THE FINAL DEADLINE''' (See [[#notesOnDryRuns|notes below]]). * March 28th, 2011, 23:59 Pacific Standard Time - '''Final''' deadline for Competitors Submission '''to Model & Solve Competition Track'''. * March 29th, 2011 - Start of the unmanned official competition run of the Model & Solve Track. * May 16th 2011 - Announcement of results and awards at [[https://sites.google.com/site/lpnmr11/ |LPNMR 2011]] - Vancouver, BC, Canada. }}} |
| Line 69: | Line 117: |
| In this track, the specification language and the problem encoding are open to the choice of participants. Specialized solutions are allowed: any submitted solution must be fairly based on a declarative specification system. Rankings on the Model and Solve competition should give a fairly objective measure of what one can expect when a system is adjusted with an encoding of choice and with an evaluation technique of choice for the problem at hand. == Awards == The competition will award a winner for the System Competition and a winner for the Model & Solve competition. |
<<Anchor(notesOnDryRuns)>> * '''NOTES on Dry Runs''' - Systems already submitted and set up by the date of a Dry Run deadline will be automatically tested on official instances featured by the related track (System/Model&Solve). Any problem on the dry run will be privately reported to competitors. Competitors submissions to related track ''will be'' '''not closed''' until the given final deadline of the track; systems not submitted within the Dry Run deadline will simply not undergo the dry run itself. |
| Line 80: | Line 121: |
== Important Dates == * January 4th, 2011 - Deadline for problem submission * January 5-10th, 2011 - Submission of accepted benchmarks in finalized version * February 4th, 2011 - Deadline for Systems submission * February 5-25th, 2011 - Competition stage * May 16th 2011 - Announcement of results and awards at LPNMR 2011 - Vancouver, BC, Canada. |
|
| Line 90: | Line 122: |
| * Contact the Organizing Committee [[mailto:aspcomp2011_REPLACE_WITH_AT_mat.unical.it |here]]. == Detailed Information == * Competition Categories * [[SystemCompetition|System Competition]] * [[MSCompetition|Model & Solve Competition]] * [[ParticipationRules|Scoring and Participation Rules]] * [[http://www.mat.unical.it/aspcomp2011/files/LanguageSpecifications.pdf|File and language format specifications]] * [[Benchmark problems classification]] * [[BenchmarkSubmission|Benchmark Submission procedure]] * [[ParticipantSubmission|Participant Submission procedure]] * [[NewsUpdates|News and Updates]] |
* [[OrganizingCommittee|Organizing Committee]] * Contact the Organizing Committee [[mailto:aspcomp2011_REPLACE_WITH_AT_mat.unical.it |here]]. |
Third (Open) Answer Set Programming Competition - 2011
The Third Answer Set Programming Competition is now over: have a look at the 4th ASP Competition site.
Contents
Current Status
Fix to outcomes of problem 22 (Hanoi Towers). Access results section in order to get new data. Have a look at some shots from LPNMR'11!
The Organizing Committee of the Third Answer Set Programming Competition, held at the Department of Mathematics of University of Calabria, is pleased to herald final results (publicly announced at LPNMR 2011 - Vancouver, BC, Canada). And the winner is... well, have a look at the : System Track Official Results -- Model & Solve Track Official Results.
- Competition:
System Track: over.
Model & Solve Track: over.
Official Results
Competition Stuff - Quick directions
Results: for both System and Model & Solve tracks, outcomes and standings are provided on the overall, per each category, per each benchmark, and even on an instance-by-instance basis.
List of participants, along with detailed info and run packages for the sake of reproducibility.
Problem Suite, featuring the benchmark problems participants compared on. Please find complete descriptions, encodings where available, complete set of instances, and much more.
Official Awards.
- Info about the competition set-up:
Reports and Slides
The preliminary report of the System Track, appeared in the Proceedings of LPNMR'11, is available HERE.
The slides of the talk given at LPNMR 2011 - Vancouver, BC, Canada, are available HERE (PDF file).
Pictures
Pictures: some shots taken at LPNMR 2011.
Awards
The 3rd ASP competition is divided into two main sub-tracks (System Track and Model & Solve Track) and awards:
- The winner of the System Track
The winner of the Model & Solve Track
In both competition tracks, winners in the respective subcategories are awarded:
Model & Solve Track
- Winner of the P category (polynomial problems)
- Winner of the NP category (NP-Hard problems)
- Winner of the Beyond NP category (more-than-NP-Hard problems)
- Optimization (Optimization problems)
System Track
- Winner of the P category (polynomial problems)
- Winner of the NP category (NP-Hard problems)
- Winner of the Beyond NP category (more-than-NP-Hard problems)
Detailed Information
- Competition Categories
- Former competitions:
News and updates
- June 09, 2011 - Fix to outcomes of problem 22 (Hanoi Towers).
May 18, 2011 - Results (announced at LPNMR 2011 - Vancouver, BC, Canada) are available. And the winner is... well, have a look at the : System Track Official Results -- Model & Solve Track Official Results.
May 18, 2011 - Complete list of participants available.
Mar 05, 2011 - Update file and language format specifications. Please have a look at the change log.
Feb 10, 2011. New Deadline extension for the Model & Solve track: March 15th, 2011. Note that the deadline for the System track does not change.
Feb 4th, 2011. Detailed regulations on memory limits in the rules section.
Feb 1st, 2011. Added a clarification regarding randomized systems in the rules section.
Jan 28th, 2011. Added a tool (from KU-Leuven KRR group) for graphically displaying problem solutions, in the Tools & Utilities page.
Jan 26th, 2011. Modified file and language format specifications. Please have a look at the change log.
Jan 20th, 2011. Shifter tool updated with enable syntax trasformation option (transforms '<>' into '!=', and 'v' into '|')!
Jan 18th, 2011. You can find in the Official Problem Suite the final problem specifications (continously updated). Stay in touch!
Jan 10th, 2011. Modified file and language format specifications. Please have a look at the change log.
January 5th, 2011. Released a preliminary problem list.
You might want to subscribe this page for getting e-mail notifications about news (needs opening an user account).
Important Dates
- Competition stage schedule:
February 18th, 2011 - System Track Dry Run start. THIS IS NOT THE FINAL DEADLINE (See notes below).
February 25th, 2011, 23:59 Pacific Standard Time - Final deadline for Competitors Submission to System Competition Track.
- February 26th, 2011 - Start of the unmanned official competition run of the System Track.
March 08th, 2011 - Model & Solve Dry Run start. THIS IS NOT THE FINAL DEADLINE (See notes below).
March 28th, 2011, 23:59 Pacific Standard Time - Final deadline for Competitors Submission to Model & Solve Competition Track.
March 29th, 2011 - Start of the unmanned official competition run of the Model & Solve Track.
May 16th 2011 - Announcement of results and awards at LPNMR 2011 - Vancouver, BC, Canada.
NOTES on Dry Runs - Systems already submitted and set up by the date of a Dry Run deadline will be automatically tested on official instances featured by the related track (System/Model&Solve). Any problem on the dry run will be privately reported to competitors. Competitors submissions to related track will be not closed until the given final deadline of the track; systems not submitted within the Dry Run deadline will simply not undergo the dry run itself.
Contacts
Contact the Organizing Committee here.