welcome: please sign in
location: Diff for "FrontPage"
Differences between revisions 49 and 79 (spanning 30 versions)
Revision 49 as of 2014-01-09 15:39:16
Size: 5670
Comment: add new alert.
Revision 79 as of 2014-04-09 10:26:07
Size: 6163
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= Fourth (Open) Answer Set Programming Competition - 2013 = = Fifth Answer Set Programming Competition (ASPCOMP 2014) =
Line 3: Line 4:
The Fifth Answer Set Programming Competition will take place as one of the events within the [[http://vsl2014.at/olympics/|FLoC Olympic Games]], held in Vienna in the context of the [[http://vsl2014.at/|Vienna Summer of Logic 2014]]. The Fifth Answer Set Programming Competition (ASPCOMP 2014) will take place as one of the events within the [[http://vsl2014.at/olympics/|FLoC Olympic Games]], held in Vienna in the context of the [[http://vsl2014.at/|Vienna Summer of Logic 2014]]. The event is officially affiliated with the [[http://users.ugent.be/~tschrijv/ICLP2014/|30th International Conference on Logic Programming]] (ICLP 2014).
Line 8: Line 9:
== Current Status ==
 
 * Oct 8th, 2013. Added some missing data to [[https://www.mat.unical.it/aspcomp2013/files/links/auxscripts/reporting/|detailed results]]
 * Oct 5th, 2013. Detailed results [[https://www.mat.unical.it/aspcomp2013/files/links/auxscripts/reporting/|available]].
 * Sep 19th, 2013. Results of the competition are announced! Here are the Announcement Talk [[http://www.mat.unical.it/ianni/storage/aspcomp-2013-lpnmrtalk.pdf|Slides]]. Per benchmark results to be published as soon as possible.
Line 16: Line 11:
'''NOTE''': Preliminary schedule, subject to further modification. Please check this site out often for news and updates.
 * March 1st, 2014: Participant registration opens
 * March 31st, 2014: Participant registration closes (new)
 * April 16th, 2014: Competition server closes to participants
 * April 16th, 2014: The competition starts (extended)
 * July 2014: Awards are presented at FLoC (22nd) and at ICLP (19th-22nd)
Line 17: Line 18:
 * Problem selection stage:
  * Aug 31th, 2012 - Problem submission deadline.
 * Competition stage:
  * Mar 16th, 2013, 23:59 PST - '''Model & Solve''' participant submission deadline
  * Mar 16th, 2013, 23:59 PST - '''System''' participant submission deadline
  * Mar 17th, 2013 - The Competition runs!
== Call for Participation ==
 * Please find the official Call for Participation [[attachment:aspcomp2014-cfp.txt|here]].
Line 25: Line 22:
 * 31 March, 2014: Application procedure updated
 * 14 March, 2014: Important dates updated
 * 20 February, 2014: Application directions now available, registration opens March 1st, 2014.
 * 11 February, 2014: Call for Participation updated. Please check it out!
 * 03 February, 2014: '''Announcement''' - ASPCOMP 2014 is officially affiliated with the [[http://users.ugent.be/~tschrijv/ICLP2014/|30th International Conference on Logic Programming]] (ICLP 2014).
 * 03 February, 2014: Call for participation updated.
 * 13 January, 2014: Preliminary Call for Participation out.
Line 26: Line 30:
  * September 6th, 2013 - Full participant packages, featuring binaries, scripts and settings, are available. Check it out at [[Participants]] page.
  * Aug 7th, 2013. The full instance set is now [[https://www.mat.unical.it/ianni/aspcomp2013instances/|available]]
  * Apr 9th, 2013: the numbers chosen as starting seed are 15-35-38-44-48, as of the [[https://www.national-lottery.co.uk/player/euromillions/results/prizeBreakdown.ftl?drawNumber=579&drawSequence=0|Euromillion Lottery]] of Tuesday April 9th 2013.
== Application and Submission Procedure ==
##Please find details about application and submission procedure [[ParticipantSubmission|here]].
Line 30: Line 33:
 * Mar 2nd, 2013:
   * A small fix to the ASP-Core-2 Validator (see the [[ASPStandardization|ASP Standardization]] page)
 * Feb 24th, 2013:
   * Added some technical details to the Instance Selection and Scoring document ([[https://www.mat.unical.it/aspcomp2013/files/scoringdetails2013.pdf|v2.2]])
   * Published instance hash values [[OfficialProblemSuite|here]].
 * Feb 16th, 2013:
   * Participant package instructions [[https://www.mat.unical.it/aspcomp2013/ParticipantSubmission|available]]
   * Update to the scoring system [[http://www.mat.unical.it/aspcomp2013/files/scoringdetails2013.pdf|document]]
 * Opened the [[ASPStandardization|ASP Standardization]] activity page.
 * Dec 6th, 2012 - The ASP-Core-2 validator is [[ASPStandardization|available]]
 * Dec 4th, 2012 - Small fixes to [[ASPStandardization|ASP-Core-2 Specification]]
 * The [[CallforParticipation|Call for participation]] is out!
 * Nov 16th, 2012 - [[ASPStandardization|ASP-Core-2 Specification]] is out!
 * May 11th, 2012 - Call for Benchmarks [[BenchmarkSubmission|available]].
 * May 7th, 2012 - Webpage started.
=== Application Procedure ===
Participants willing to apply for the competition can send an email (starting from March 1st, 2014) to [[mailto:aspcomp2014@mat.unical.it|this address]] specifying:
 * the name of their team;
 * names and affiliation of the team members (institution, research group);
 * name and number of the systems the team will submit;
 * specification about whether a system is an updated version of a solution submitted to the 2013 edition;
 * specific software requirements: e.g. linux packages/libraries needed to run your system.
 * language support: e.g. <<our submission supports normal logic programs and aggregates, it does not support weak constraints and function symbol>>, or so, etc.
Line 46: Line 42:
  == What is the Open ASP Competition? == Applicants will get a private e-mail with the instructions for submitting systems and login credentials for accessing our Competition server through ssh.
Line 49: Line 44:
The Open ASP Competition has two tracks: the [[MSCompetition|Model & Solve Track]] and the [[SystemCompetition|System Track]]. === System Package(s) submission ===
Once received the instructions via e-mail, participants can log in onto the competition hardware system, and are free to use their account for building, testing, and submitting systems packages purposes; access is avalaible until the day before the competition starts.
Line 51: Line 47:
 * In the '''Model & Solve Track''', a number of problem domain specifications are given, together with a set of instances thereof. All you need to participate is a system able to model using a declarative specification paradigm of any sort, and some manpower for preparing benchmark solutions. Winners are awarded on the basis of their time performance and, for optimization problems, on the basis of the quality of their solutions. Note that we are more interested at comparing systems and their performance on standard problems, rather than measuring the modelling 'trickery' of participants: this is why you will have several months for preparing declarative specifications and your system, so to make affordable the burden of modelling a number of problems, also for small teams. Problem specification can be freely exchanged among participants whenever they use the same input language. In order to properly submit a system package, please create a sub-directory with the name of your system in the directory '''"submission"''' of your home. In case of several systems submissions, please create ''a sub-directory for each system''.
Line 53: Line 49:
 * The '''System Track''' is reserved to Answer Set Programming systems, able to cope with a fixed problem specification language. The 4th ASP Competition will be held on an extension of ASP-Core called [[ASPStandardization|ASP-Core-2]]. '''Reminder:''' participants can log in and update their submission until the competition starts. Please check the deadline out in the [[#schedule|above section]].
Line 55: Line 51:
To have an idea of the type of problems involved and what we measure on competitors, you might want to visit the [[OfficialProblemSuite|official problem list]] and [[ParticipationRules|Rules & Scoring system]]. ==== Package Structure ====
The structure of your submission package must be the following:
Line 57: Line 54:
<<Anchor(detailed)>>
== Detailed Information ==
 * [[BenchmarkSubmission|Call for benchmarks and benchmark Submission procedure]]
 * [[CallforParticipation|Call for participation]]
 * Competition Categories
  The competition features ''two distinct tracks'':
  * [[MSCompetition|Model & Solve Competition]]
  * [[SystemCompetition|System Competition]]
 * [[ParticipationRules|Detailed Scoring and Participation Rules]]
 * [[ParticipantSubmission|Participant Submission procedure]]
 * [[NewsUpdates|News and Updates]]
 * [[ToolsUtilities|Tools and Utilities]]
 * Former competitions:
   * [[https://www.mat.unical.it/aspcomp2011|Third]] ASP Competition
   * [[http://dtai.cs.kuleuven.be/events/ASP-competition/index.shtml|Second]] ASP Competition
   * [[http://asparagus.cs.uni-potsdam.de/contest/|First]] ASP Competition
{{{
    system-name
      └ bin
          └ run
          └ mysolver
          └ my_helper_tool
}}}

Your package should contain ''at least'' a folder named bin. Your package is expected to be launched with the same configuration for all the benchmark domains, i.e., the package must comprise all files required for running your system, on ''any problem encoding and any problem instance''.

==== Command Line ====
The main script "run" takes three arguments:
 * The first argument ($1, argv[1], ...) is the maximum integer (0 if not meaningful for the problem/instance at hand).
 * The second argument ($2, argv[2], ...) is the maximum nesting level of functional terms (0 if not meaningful for the problem/instance at hand).
 * The third argument ($3, argv[3], ...) is a comma-separated list of output predicates p1/n1, p2/n2,... with predicate names pi and arities ni. The list coincides with the list of output predicates which are allowed in the output of the run script. For each domain, the list can be found in the related checker folder, for convenience.

Of course, participants are free to design submitted scripts in order to take into account the three arguments, or not.

A problem instance in the prescribed format is fed to run's standard input. The output of each run must be printed to standard output, and a proper exit code must be issued, according to the competition format.

More details on input and output are available here <<< put link to referenced text ['''to be updated''']

An example of run script can be found here <<<<link to example ['''to be updated''']
Line 75: Line 79:
You might want to [[https://www.mat.unical.it/aspcomp2013/FrontPage?action=subscribe|subscribe]] this page
for getting e-mail notifications about news (needs [[https://www.mat.unical.it/aspcomp2013/FrontPage?action=login|opening]] an user account).
== Rules, Scoring and Details ==
To be updated.

=== Rules and Scoring ===
Please find details about rules and scoring [[attachment:aspcomp2014-rules-and-scoring.txt|here]].

=== Output format ===
Output format should not change with respect to ASPCOMP 2013. Please find further info [[https://www.mat.unical.it/aspcomp2013/files/aspoutput.txt|here]].
Line 80: Line 90:
 * [[OrganizingCommittee|Organizing Committee]]
 * [[mailto:aspcomp2013_REPLACE_WITH_AT_kr.tuwien.ac.at|Contact the competition organizers]].
=== Organizing Committee ===

The Fifth Answer Set Programming Competition is hosted and regulated jointly by Aalto University (Finland), University of Calabria (Italy) and University of Genova (Italy).

==== Co-Chairs ====
 * [[https://www.mat.unical.it/calimeri|Francesco Calimeri]]
 * [[https://people.aalto.fi/index.html?profilepage=isfor#!martin_gebser|Martin Gebser]]
 * [[http://www.star.dist.unige.it/~marco|Marco Maratea]]
 * [[https://www.mat.unical.it/~ricca|Francesco Ricca]]

==== Email and Contacts ====
 * Drop us a note at aspcomp2014@mat.unical.it.

Fifth Answer Set Programming Competition (ASPCOMP 2014)

The Fifth Answer Set Programming Competition (ASPCOMP 2014) will take place as one of the events within the FLoC Olympic Games, held in Vienna in the context of the Vienna Summer of Logic 2014. The event is officially affiliated with the 30th International Conference on Logic Programming (ICLP 2014).

Important Dates

NOTE: Preliminary schedule, subject to further modification. Please check this site out often for news and updates.

  • March 1st, 2014: Participant registration opens
  • March 31st, 2014: Participant registration closes (new)
  • April 16th, 2014: Competition server closes to participants
  • April 16th, 2014: The competition starts (extended)
  • July 2014: Awards are presented at FLoC (22nd) and at ICLP (19th-22nd)

Call for Participation

  • Please find the official Call for Participation here.

News and updates

  • 31 March, 2014: Application procedure updated
  • 14 March, 2014: Important dates updated
  • 20 February, 2014: Application directions now available, registration opens March 1st, 2014.
  • 11 February, 2014: Call for Participation updated. Please check it out!
  • 03 February, 2014: Announcement - ASPCOMP 2014 is officially affiliated with the 30th International Conference on Logic Programming (ICLP 2014).

  • 03 February, 2014: Call for participation updated.
  • 13 January, 2014: Preliminary Call for Participation out.

Application and Submission Procedure

Application Procedure

Participants willing to apply for the competition can send an email (starting from March 1st, 2014) to this address specifying:

  • the name of their team;
  • names and affiliation of the team members (institution, research group);
  • name and number of the systems the team will submit;
  • specification about whether a system is an updated version of a solution submitted to the 2013 edition;
  • specific software requirements: e.g. linux packages/libraries needed to run your system.
  • language support: e.g. <<our submission supports normal logic programs and aggregates, it does not support weak constraints and function symbol>>, or so, etc.

Applicants will get a private e-mail with the instructions for submitting systems and login credentials for accessing our Competition server through ssh.

System Package(s) submission

Once received the instructions via e-mail, participants can log in onto the competition hardware system, and are free to use their account for building, testing, and submitting systems packages purposes; access is avalaible until the day before the competition starts.

In order to properly submit a system package, please create a sub-directory with the name of your system in the directory "submission" of your home. In case of several systems submissions, please create a sub-directory for each system.

Reminder: participants can log in and update their submission until the competition starts. Please check the deadline out in the above section.

Package Structure

The structure of your submission package must be the following:

    system-name
      └ bin
          └ run
          └ mysolver
          └ my_helper_tool

Your package should contain at least a folder named bin. Your package is expected to be launched with the same configuration for all the benchmark domains, i.e., the package must comprise all files required for running your system, on any problem encoding and any problem instance.

Command Line

The main script "run" takes three arguments:

  • The first argument ($1, argv[1], ...) is the maximum integer (0 if not meaningful for the problem/instance at hand).
  • The second argument ($2, argv[2], ...) is the maximum nesting level of functional terms (0 if not meaningful for the problem/instance at hand).
  • The third argument ($3, argv[3], ...) is a comma-separated list of output predicates p1/n1, p2/n2,... with predicate names pi and arities ni. The list coincides with the list of output predicates which are allowed in the output of the run script. For each domain, the list can be found in the related checker folder, for convenience.

Of course, participants are free to design submitted scripts in order to take into account the three arguments, or not.

A problem instance in the prescribed format is fed to run's standard input. The output of each run must be printed to standard output, and a proper exit code must be issued, according to the competition format.

More details on input and output are available here <<< put link to referenced text [to be updated]

An example of run script can be found here <<<<link to example [to be updated]

Rules, Scoring and Details

To be updated.

Rules and Scoring

Please find details about rules and scoring here.

Output format

Output format should not change with respect to ASPCOMP 2013. Please find further info here.

Contacts

Organizing Committee

The Fifth Answer Set Programming Competition is hosted and regulated jointly by Aalto University (Finland), University of Calabria (Italy) and University of Genova (Italy).

Co-Chairs

Email and Contacts

Fifth Answer Set Programming Competition (ASPCOMP 2014): FrontPage (last edited 2015-08-06 10:02:44 by FrancescoCalimeri)