Where work is checked on the exam. How I was an exam expert

The USE is called the final state certification, which, as a rule, is carried out according to programs of general secondary education. The check is carried out officially in all educational institutions of the Russian Federation. This is a written exam, which is taken in Russian, the only exception is the "Speaking" section of the foreign language certification. The exam schedule is the same throughout the country. The following categories are eligible to take part in the exam:

• school graduates, including those of previous years;
• students who receive specialized education;
• students of foreign educational institutions.

The exam is carried out in the following subjects:

1. Russian language.
2. Maths.
3. Social Studies.
4. Chemistry.
5. Physics.
6. Biology.
7. History.
8. Computer science.
9. Geography.
10. Literature.
11. Foreign languages ​​(English, Spanish, French, German)

Russian language and mathematics are mandatory for graduates of the current year. For everyone else, the choice of subjects depends on what specialty they want to choose for admission to the university.

Who checks the work of graduates on the exam

On the exam, graduates gain points for test and detailed answers. In all subjects, except for the basic level of mathematics, the USE is evaluated on a 100-point system. There is a generally accepted minimum score that a graduate must achieve in order to pass the exam.

The tasks themselves are divided into three parts:

• A (choice of an answer from four options);
• B (short monosyllabic answer, choice of one or more options from the proposed ones);
• С (tasks requiring a detailed answer).

As far as verification is concerned, the results of Part A and B are verified with absolutely no human intervention. Everything is mechanized, they are checked by a computer, scanning and automatically recognizing the correct answers. Therefore, mark as carefully as possible so that the machine does not accidentally count the correct answer for an error.

As for sector C, people are already checking it. For objectivity, two specialists are invited who work independently of each other. Since data is processed by people, there are several nuances:

1. The scores given by the experts coincided, then the score received is awarded for the task.
2. The marks differ, but not cardinally, in this case the average mark is given.
3. It is also possible that the scores differ significantly. In this case, the third expert comes to the rescue. The latter checks the work, but focuses only on those tasks in which the previous reviewers disagreed.

After verification, the forms with grades are scanned and sent to Moscow on the portal of the Unified Testing Center of the Ministry of Education. There, the results of the exam are processed and entered into the database, from where they go to those institutions where the graduates passed the exams.

It should be borne in mind that the computer processing system is capable of error. For example, part B may have a illegible word, or your pen was poorly written (the ink is too light). In this case, you should not worry. If you see that you were clearly not enough points, you can appeal that you disagree with the results. But keep in mind that the committee has the right to revise the results both upward and downward, and nothing can be changed, and your points in the system are tied to your passport data.

The Regional Clearinghouse is responsible for assessing the results of the exams, so all complaints are directed there. Think twice before filing an appeal, and if you are not sure that the error is in the assessment, then it is better to just accept the results.

After processing at the Regional Center, the forms are sent to the Federal Testing Center as described above. Here the options of the USE participants are checked against the correct answers.

It is important to know that the exam results are up-to-date and valid for 4 years. And for those who doubt the correctness of the verification of the results, you need to know that the appeal can be filed within 2 working days.

After the regional centers send the results to the Federal Center, it takes about 5 working days to recheck all the forms. But this is not the end. After that, one more working day is still needed for the results to be approved by the State Examination Commission. In the next 3 days, the results are published. You can find out your scores either on the Internet on the portal of the center of grading, or in the place where you wrote the exam. If you live in remote regions, most likely, the results will come with a delay, usually no more than 12 days.

Retaking the exam

There is the possibility of retaking the exam in two main disciplines: Russian and mathematics. But you can write the exam again only in one of the subjects in one year. That is, if you did not score enough points in both subjects, then the possibility of retaking will only be next year. And those graduates who, with the help of an appeal, annul the exam results, also have the right to retake only the next year.

It may happen that the days of writing exams in two subjects fall on one day. In this case, you should not panic, since there are reserve days for delivery.

Applicants are allowed to retake who:

• failed to show up for change for a good reason. It may be some kind of serious illness (confirmed by a certificate from a medical institution);
• if the exam results were canceled, but only if a mistake was made by the organizers.

Remember that you can only use a black gel pen to write on your exam papers. This is necessary so that there are no problems with scanning your work and for its correct processing. Try to write in calligraphy so that the scanner can read all letters accurately. In the form with assignments, you can write the way you want: it is not forbidden to make notes in the margins, to make calculations. Points are not deducted for this.

As you get down to writing Part C, don't worry. Even if the topic is very difficult for you, try to write at least something. Since this part is already checked by people, and not by mechanisms, the human factor also matters. The examiner can be caught either condescending or picky. You may get a credit for trying if you can see that you really put in the effort.

The processing system for the first two parts is improved every year. New programs, modern equipment, progress does not stand still. The problem remains only with the evaluators evaluating the third part. Alas, a specialist may be caught who carelessly approaches his duties as an examiner of the exam, not fully realizing that someone's fate depends on his work. Time passes and after a while, most likely, everything will be mechanized.

If you follow all the rules for passing the unified state exams, properly prepare for them and approach it responsibly, then there should be no problems with passing and gaining a sufficient number of points. If you did not learn anything and did not prepare in any way, then it is better not to try to criticize the system and try to challenge its rules, all the same, nothing will work. The system was not created by stupid people who calculated and thought everything over.

In order to get your work checked quickly and there are no controversies, do not forget about the color of the pen and tips regarding handwriting. If the examiner cannot make out what is written, he will count the wrong answer. A large number of corrections will also not play into the hands, since the grade is lowered for inaccurate work.

The Unified State Exam-2012 has already died down, but there are still many questions about its implementation. Let's try to answer at least some of them. How the Unified State Exam in Mathematics was checked is described by the Chairman of the Subject Commission for Checking Assignments with a Detailed Answer of the Unified State Exam in Mathematics 2012 in the Republic of Mordovia, Candidate of Physical and Mathematical Sciences, Associate Professor of the Department of Mathematics and Theoretical Mechanics of Moscow State University. N.P. Ogareva Alexey Olegovich Syromyasov.

How is the commission that deals with the verification formed? What are the criteria for recruiting auditors and who recruits them?

The commission should include school teachers (as a rule, of the highest category), teachers of secondary specialized educational institutions and universities, and representatives of secondary and higher education - approximately on a parity basis. This is logical: schools graduate students, and universities accept them. This side of the process is somewhat reminiscent of the handover and acceptance of work: the commission includes both the handing over party (secondary education) and the accepting party (universities).

In winter, a few months before the exam, the Ministry of Education appeals to the education departments in Saransk, Ruzayevka and regions of the republic with a request to nominate school teachers - members of the commission. With the same requests regarding teachers, it turns to universities and colleges. The ministry decides on the appointment of the chairman of the commission.

All experts undergo compulsory preliminary training in the spring under the FIPI (Federal Institute for Pedagogical Measurements) programs. It should be immediately clarified that FIPI is exactly the organization that oversees the preparation of exam tasks.

Most of it takes place remotely, via the Internet - at the request of the Ministry of Education, FIPI provides the required number of accounts to enter the training system. The rest of the committee listens to lectures in person. In any case, training takes place on training (approximate) criteria that are in the public domain, and ends with a test. Experts who have not undergone training in one form or another, have not passed the test, are not allowed to check the work of the Unified State Exam.

The chairman looks at the list presented. He can reject some of the candidates or propose someone else. But the approval of the composition of the commission is the prerogative of the ministry.

All these appointments are made in agreement with those educational institutions where potential experts work.

And who appoints the chairman of the commission? And how did you become the chairman?

I have been the chairman for the second year (that's why I'm talking with such confidence about how everything was staged last year). In the winter of 2010-2011, the Ministry of Education of the Republic of Moldova appealed to the rector of our university S.M. Vdovin and the dean of the Faculty of Mathematics, I.I. Chuchaev, with an official request - to agree on my candidacy. Perhaps the role was played by the fact that at the Unified State Exam in 2010 I was one of the employees of the RCOI.

This offer was unexpected for me. Of course, at first there were serious doubts whether I could handle it or not. Judging by the fact that in the 2011-2012 academic year the ministry again asked to agree on my candidacy, it was satisfied with the quality of the work done.

Most students and even teachers do not have a complete understanding of how assignments are checked. Where should they get this information from? And how is the check actually organized?

When the time allotted for completing the USE assignments comes to an end, all the forms completed by the students are taken to the RCOI (regional information processing center). Only copies of Form No. 2 (that is, the forms on which the solutions to the problems of group "C" are written) are sent to the commission for verification. Forms No. 1 (with tasks "A" and "B") are checked automatically on a computer, the commission has nothing to do with them.

Here I would like to draw your attention to 2 circumstances:
- The commission checks exactly the copies. The originals are inviolable, so you cannot "paint on" something in the form during the check.
- Answer forms # 2 (respectively, and their copies) are anonymous. They are combined with registration forms and forms No. 1 only by a special program using a barcode. Accordingly, the experts do not know whose work they are checking.

The criteria for checking the assignments of part "C" are sent to the RCOI mail in the evening of the day when the subject was examined (of course, after the exam is over). The Commission reviews these criteria the next morning. They are printed in the required quantity and the check begins.

The whole procedure takes place in the same building in which the RCOI is located (this is more convenient). A special program automatically assigns the jobs to be checked by one or another expert, then these jobs are printed out together with a form of the protocol, where the results of the check are then entered. Those. the experts are faced with the fact: you check such and such works. There are no surnames or other data of the USE participants in the protocols - only a conditional work code (in my opinion, 12 or 13 digits). Each work is checked independently by two experts, and experts cannot consult with each other. Further, copies of the work together with the completed protocols are handed over, the protocols are scanned and automatically checked against each other. If the difference in points for the same task is 2 or more, the work is sent to the "third expert". Thus, each work is checked at least twice, or even three times.

In the auditoriums where the commission works, web cameras are installed, the image is displayed on the screen to the director of the RCOI. Members of the State Examination Commission (SEC), which in Mordovia includes the deputy. the head of the government M.S. Sezganov, the leadership of the Ministry of Education, rectors of universities, etc. they can also, if they wish, at any time familiarize themselves with these videos. Therefore, the actions of the commission during the audit are under constant control.

General information on the verification procedure can be obtained on the official portal of the Unified State Exam: www.ege.edu.ru.

So, the summary:
- works are anonymous;
- copies are checked, not originals;
- the test criteria become known only after the end of the exam;
- verification takes place under the control of the outside.

In your personal opinion, how objectively does the USE show the knowledge of schoolchildren? Is it safe to say that a stronger student is more likely to receive a higher score?

Let's just say: a stronger student, all other things being equal, will receive a higher score. But all sorts of accidents are possible, not documented in any way: the night before, he had a fight in the family, put on a new, unworn boot, which was pressing, etc. There can be many reasons for failure, even ridiculous ones, and all of them will be respectful, although they cannot be confirmed by any certificate. As with any university exam, however.

In addition, there is a small group of students who are fundamentally unexamined. Simply by their psychological organization - they can solve problems well from the spot and at the blackboard, but they cannot pass the exam (or they can, but show worse results than their usual ones).

The exam is standardization. But it is impossible to standardize a million people, there will certainly be deviations in one direction. Therefore, along with the results of the exam, all kinds of Olympiads are taken into account when enrolling in universities.

The question of the objectivity of the USE is also closely related to the question of the content of the test criteria. At the end of the exam, the commission can express its opinion on the work of students, and on the criteria themselves. The chairman includes these opinions in the report, which is submitted to the Ministry of Education and sent to Moscow. Thus, FIPI maintains feedback with subject commissions in the regions.

And what is the opinion of the Mordovian Commission on the criteria?

In general, it was suggested that the verification criteria be relaxed somewhat. (This opinion is official, it has already gone to Moscow, and Moscow took note of it.)

Were the test criteria too strict? How was this manifested?

Without going into the specifics of specific tasks: in order to get a certain score, a student in his decision needed to reach a certain milestone and get the corresponding intermediate result. If this result was not achieved due to some mistake (even an accidental slip of the tongue), the USE participant no longer received the corresponding points. Figuratively speaking, to get 2 points, you need to run 2 km over rough terrain. But if you run 1 km 900 m, you will not get more than 1 point - after all, the finish has not been reached!

At the same time, the school, as a rule, assesses not only the result itself, but also the process of achieving it.

There were cases when, when checking task C3, a student made a single mistake, but it turned 3 primary points (in which task C3 in mathematics is assessed as the maximum) into 1 point. Naturally, this decision was rated 1 point.

Here I must say that regardless of whether the commissions like the criteria or not, the commission works according to the criteria that were sent from Moscow.

As one of the characters of the Strugatsky brothers said, “When I come to another country, I don’t ask if the laws are good or bad. I ask if they are being followed.”

So, the commission, within the framework of its powers, is trying to influence the criteria and content of assignments, but this may be reflected in the criteria for the next year. At the end of the check, we expressed our opinion (see above), and until the check is completed, we are obliged to adhere to the already existing rules.

Is there any control over the cheating during the check process? If, for example, 2 identical works are found, can the commission apply any sanctions?

The question is more theoretical.

Experts, as already mentioned, should not confer with each other and compare works, therefore it is required that two identical works get to the same expert. I do not know how likely this is, because I am not aware of the details of the work of the program, which assigns copies of the forms to the experts for verification.

When checking works in mathematics, such situations did not arise.

In the event of any abnormal situation, the commission will contact the RCROI (to eliminate the issue of technical problems) and the GEC.The task of the subject commission is to check the anonymous work in accordance with the criteria developed by the FIPI.

What is the correct way to file appeals? How successful were the students this year?

As far as I know, in mathematics, less than half of the appeals filed were satisfied (in my opinion, about 30%). At the same time, some experts check the work, and the appeals are considered by others. This is natural: an appeal is a kind of quality control of the audit, and this quality is already controlled by other people - not those who participated in the audit. Of the members of the subject commission, only the chairman is present at the appeals: in some controversial cases, he can be asked for clarifications.

It makes sense to file an appeal when the USE participant is more or less sure that this can increase his points. The fact is that on appeal, all work is rechecked (tasks "C"). Therefore, the USE participant can not only increase, but also lower his points (if a previously unnoticed error is discovered during rechecking).

Before filing an appeal (for that matter, and before writing an exam), it is advisable to familiarize yourself with the approximate test criteria. Of course, even experts become aware of the "combat" criteria for checking USE assignments only after the exam. But the type of assignments for each subject, the demo version and the so-called specification (description - which assignment of the USE tests what skills) can be downloaded completely free from the official website of the previously mentioned Federal Institute of Pedagogical Measurements at least from December-January. In the same place, in the demo version, there are also approximate criteria by which tasks "C" will be checked. Here is their address.

Who checks the exam papers, what to do if the form is damaged, how to appeal and whether it is possible to get answers in advance

Coordinates public observers

Who checks the exam papers

A computer.Forms of the test part are processed using a computer: the specialists of the information processing center scan the works, then the program checks the answers from the form with the correct answers. To avoid automatic checking errors, write legibly and with black pen only. If you suspect that you have lost a point for a technical reason, for example, because of a vaguely marked answer, it is better to appeal.

USE experts.Tasks with a detailed answer are checked by the subject commission of teachers of the region. Each work is checked at once by two expert teachers. If the assessors' assessments differ significantly, the work is transferred to a third expert.If the discrepancy in points is small, then the arithmetic mean of the assessments of the two experts will be rounded up.

What to do if the USE form is damaged

Contact the organizer.If you messed up the form before starting the exam, the organizer will replace it along with the set of assignments. If you spoil the form when you have already started completing the assignments, you will have to hand it over to the organizer and come to the exam on a reserve day. Keep in mind that mistakes in answers are not a reason to change forms.

Write your answer in the reserved field.Most often, graduates make mistakes when filling out short answers. If you gave an incorrect answer and noticed an error, use the special field at the bottom of the page. In the field for corrections, you need to enter the task number and the correct answer.

Learn to fill out the form correctly... To avoid annoying blots, mistakes and not to waste time on formalities, practice at home. Open demo versions of KIMs for your subjects on the FIPI website. Carefully read and memorize the rules for filling out the forms: how to fill out this or that task, which punctuation marks to enter with spaces, and which without, which characters to put in one cell, and which ones between the cells.

When is it worth filing an appeal

The appeal is filed in two cases:

1. The procedure for holding the Unified State Exam has been violated.If outside noise or the actions of other participants in the classroom interfered with the exam, report it right away. In case of a violation of the order of the exam, file an appeal before leaving the TET.
2. Disagree with the result of the exam.Disagreement with the points awarded should be appealed within two working days after the official announcement of the results. In this case, you write an application addressed to the head of the organization that admitted you to the exam (school, department of education). The leader must submit the application to the conflict committee, which will consider your work.

How to file an appeal for the exam

Results of the appeal. The appeal may be dismissed. If the appeal is not satisfied, you will remain with your points, you will not be allowed to rewrite the work. If your appeal is upheld, your work will be rechecked, and as a result, scores may be increased or decreased.

Is it possible to get the USE answers somewhere in advance

You won't be able to get the 2018 KIMs.In previous years, there was a theoretical opportunity to open the CMMs in Vladivostok, clear them out and send the answers to Moscow by the time the exam began. This year there is no way left to get the CMMs. The fact is that all forms are brought to the examination sites in encrypted form on disks. Paper CMMs are no longer used, it is no longer possible to pay someone and decide options in advance.

The registration form and CMMs will now be printed on a printer right during the exam in front of the children. Be sure: if someone offers to buy the USE answers, they are scammers. Don't pay anyone any money, believe in yourself and your knowledge.

Are you curious to know who these mysterious experts who test the exam are and how they work? So, now you can find out about it first-hand. Because for the seventh year I have been one of these experts.

It is called very long and solidly: "expert of the subject commission for the state final certification of educational programs of secondary general education."

Since I work as an assistant professor at the Department of Information Technology, it is logical that I am an expert in computer science and ICT (information computer technology). But experts in other subjects work similarly.

Let me remind you that the USE assignments are divided into three parts: A, B and C. Part "A" is also called a "guessing game", because here the student must choose one of several answers offered to him. Part "A" is now missing in the math and literature assignments. In part "B" you need to write a short answer. For tasks of type "C" children give detailed free answers.

Answers to tasks "A" and "B" are checked by computers. But the tasks of part "C" are evaluated by experts, that is, people. Each work is checked independently by two experts. If their marks for the same answer to any task differ by one point, then a higher mark is finally given. That is, the discrepancy in the assessments of the experts is interpreted in favor of the student.

If the discrepancy is more than one point, then the work is transferred to a third expert. His assessment is final. The fewer such “third checks” the commission has, the more professional it is. Because this suggests that all experts have carefully studied the criteria for evaluating the work and put the points in the same way. If the discrepancy is more than 15%, then the team of experts can be disbanded and a new one recruited.

The subject commission is formed from the most experienced school teachers teaching this subject, and by 20-25 percent - from university teachers. In particular, there are 20 people on the subject commission on informatics and ICT of the Ivanovo region, which I am a member of, five of them are high school teachers.

Some time before the exam, experts undergo training and certification. In the first years of the USE, the study consisted of the following: we got together several times, considered the proposed tasks and tasks of previous years, looked for solutions, discussed the solutions proposed by the authors of the assignments, agreed on points of view.

In recent years, preparation for verification has been moved online. First, we are sent teaching materials, which represent the real answers of the students, assessment criteria and detailed explanations of possible difficult situations. We study these answers, evaluate them and can check ourselves whether we are doing it right. Then we pass a test, during which each expert must evaluate twenty answers to tasks of types C1, C2, C3, C4 in a limited time. If the test is passed well, that is, the expert confirms his qualifications, then he is issued with the following certificate:

On the day of the exam, all the works of graduates from all EETs of the region are sent to a single center, where the answers to the tasks of part "C" are scanned, encrypted and randomly distributed by the names of experts. The next day we come to a specially designated building, we are given options for assignments, assessment criteria and printed out specifically for each scanned answers that we must evaluate. I emphasize that the expert does not see any information about the students, only the decisions themselves.

This year, the check was carried out in rooms equipped with video and audio surveillance systems. It was impossible to take ANYTHING with you to the class and take out of the class. Moreover, we were even asked to turn off the mobile phones left in the locked room where we undressed and where we left all our belongings. That is, we carried out the test in almost the same conditions in which the students wrote the exam. True, at the entrance to the building, we did not pass through the frames of metal detectors and could leave the auditorium without an attendant.