Kaisa_2012_3_photo by Veikko Somerpuro

The seminar focuses on the emerging topics of AI & Testing.
It covers both directions:
how to use AI for testing and how to test AI systems.

The students can develop demos, do small experiments and record their results in seminar papers, or just do a literature survey.
Suggestions to work on topics that arise out of student interest or work are welcome.

Enrol

Messages

Jukka Nurminen's picture

Jukka Nurminen

Published, 10.10.2019 at 12:48

URGENT: We have to reschedule the final seminar day. The new date is Mon 9.12 at 12-16 (two weeks delay from original).

Sorry about the trouble,

Jukka

Jukka Nurminen's picture

Jukka Nurminen

Published, 10.10.2019 at 12:44

Hi,

the face to face discussion times are available on Tue 22.10. and Wed 23.10. Please book a suitable timeslot from the doodle here https://doodle.com/poll/ivcgmh52526f6z5p.

Both Tommi and Jukka will be present. The meetings in Jukka's room, Exactum D224.

Make sure that you have an updated version in Trello or a link via Trello to your paper draft by Monday 21.10. noon.

Good luck with your work in the seminar,

Jukka & Tommi

Timetable

9.9.2019 Why are we here? How the seminar works
16.9.2019 AI & Testing - Introduction to challenges and opportunities
23.9.2019 Discussion on seminar works. Be prepared to shortly describe what you plan to do

Individual work on demos, experiments and seminar papers.
7.10 1st draft
- Paper outline ready; research questions defined/demo definition ready
21.10 2nd draft
– no meeting, personal feedback sessions
- Research performed/demo in mid-stage
- Paper about 2(demo)/4(other) pages long describing the setup
4.11 3rd draft
- Complete draft available for comments from Tommi & Jukka & other staff

18.11. 4th draft
- optional but highly recommended
- F2F or email comments depending on your wishes during week 47

2.12 Final draft to the opponent

9.12.2019 12-16 Seminar results day: seminar presentations & discussions
Prepare your presentation. You will have max 20 min time for presentation + 5-10 min for discussion. My favorite instructions of good talks here: https://www.microsoft.com/en-us/research/wp-content/uploads/2016/07/How-...
University Powerpoint templates here: https://flamma.helsinki.fi/en/group/viestinta-ja-tapahtumat/valmistaudu-...

13.12.2019 Peer-review reports to Trello
Write a short (max 1 page) peer-review report of your assigned peer's paper. Instructions for writing the peer review are here https://reviewers.plos.org/resources/how-to-write-a-peer-review/ (they are not perfect fit for the seminar papers but are a real example of peer review approach). Be honest in your review - they do not directly influence your fellow student's grade. Random allocation of the peer review gives the following:
Teemu reviews Tuomas. Tuomas reviews Francesco, Francesco reviews Satu, Satu reviews Nina, and Nina reviews Teemu

18.12.2019 Final paper to Trello

DateTimeLocation
Mon 9.9.2019
12:15 - 14:00
Mon 16.9.2019
12:15 - 14:00
Mon 23.9.2019
12:15 - 14:00
Mon 7.10.2019
12:15 - 14:00
Mon 4.11.2019
12:15 - 14:00
Mon 9.12.2019
12:15 - 17:00

Other teaching

Material

Description

Master's programme in Computer Science is responsible for the course. The course belongs to following course packages and modules:

  • Programming Techniques course package CSM14200
  • Module in Programming Techniques CSM24200
  • Software Engineering course package CSM14100
  • Module in Software Engineering CSM24100

The course is available to students from other degree programmes.

CSM14201 Ohjelmistojen Testaus or other basic skills of software testing is helpful.

Basic knowledge of machine learning and other AI techniques is also useful.

The course will be offered in Fall 2019

The seminar focuses on the emerging topics of AI & Testing. It covers both directions: how to use AI for testing and how to test AI systems. The students can develop demos, do small experiments and record their results in seminar papers, or just do a literature survey. Suggestions to work on topics that arise out of student interest or work are welcome.

Topic specific scientific articles and additional related material searched during the presentation writing process.

For the writing a seminar paper, the specific guidelines from the ESE research group of the department are highly recommended:

https://www.cs.helsinki.fi/group/ese/ScientificWritingGuide.pdf

The main phases and detailed deadlines will be announced in the first session. The seminar will start with 1-3 introductory lectures on the topic and challenges. It is followed by an independent working phase. Finally, a number of sessions (in 2nd period) will be devoted to presentations and demos.

Participation to all sessions is compulsory. The seminar sessions include lectures and workshops, e.g., paper writing.

A suitable length of a seminar paper is 6-10 pages, for demo paper (3-4 pages)

Each presentation is 20 minutes. Think carefully what to include and how much presentation material can be included. Each presentation is followed by discussion in which all are expected to actively participate.

The grade for the seminar is given based on the written paper (50%), presentation/demo (30%), and reviews given to other students and activity in the course (20%). Innovativeness in topic/content gives extra credit.

The seminar will be organised close to the format of a scientific conference with peer-review practice.

The student can choose between three options:

Create a demo of selected technology and write the corresponding demo description (See e.g. http://www.icde2013.org/cfd.html about what is needed for demo submission).
Develop and report an experiment in the form of a scientific paper
Write a literature survey in the form of a scientific paper
Each participant writes a scientific/demo paper (at least in the form and style) and submits it to the conference of the course. The paper will be peer-reviews by course staff and other seminar participants. In addition, everyone presents the paper as in a conference.

The course will use EasyChair conference management system in which the paper, reviews and revised paper will be returned. Details on accessing and using the system will be given in the beginning of the course.

The paper will be formatted using IEEE conference template, which can be found from http://www.ieee.org/conferences_events/conferences/publishing/templates.html.

Participation to all sessions is compulsory and any absence needs to be compensated as agreed with the course teacher.

Jukka K. Nurminen

Tommi Mikkonen