SErAPIS is a research search engine with two objectives:

  • Collect queries and relevance decisions to build a data set for developing and evaluating Isabelle retrieval algorithms (also known as a test collection.
  • Understand the requirements and behaviour of Isabelle search users (in an anonymised manner).

In order to meet the above objectives, we store two cookies in your browser:

  • a random user ID
  • a random user session

These cookies allow us to associate queries issued to SErAPIS to their author anonymously. It is important that we can establish this link because it is known that decisions of relevance vary across query authors. The second cookie allows us to group related queries together so that we can track their evolution over time. This will enable us to look into how Isabelle queries change qualitatively over time.

We also store the following data in a database

  • An anonymised, randomly generated user ID.
  • A randomly generated user session ID.
  • a host id produced by hashing your IP address.
  • the queries you issued in each session.
  • Your relevance feedback, provided by clicking ☐ or ✅ (linked to session, user ID and query)
  • clickthrough: what result did you decide to investigate further by clicking on the link to the theory file?

The cookies we store in your browser, and the data you provide that we store in our database allow us to reconstruct search sessions and group activity by user and session. This is important for our research as highlighted above. Although we can reconstruct search sessions (including queries, relevance decisions and clickthrough) using the data collected, we cannot link the stored information to your identity (e.g., name and email address).

This website uses the encrypted communication between your browser and our server (e.g., the secure HTTP protocol, https) to maximise communication privacy.

Finally, please note that our intention is to create and release a data set that will be useful to the Isabelle search research community and will likely include anonymised user information.

We take your privacy very seriously. The data we record is anonymised: we do not ask you to (a) create an account and/or (b) provide us with personal information such as address.

We appreciate your help in our research. Thank you.