State testing of a prototype is not according to the methods. Big encyclopedia of oil and gas

January 27, 2014 08:45 AM

"And here we are, you know, all indulging in buns ..."
from the cartoon "Carlson is back"

Acceptance of the information system is, of course, the apotheosis of the entire project of creating an information system. Don't let the quote at the beginning of the article fool you, this is an important and serious event. I think that this is a holiday for both sides, but, as you know, in order for the holiday to go well, you need to prepare well for it.

Start with the format acceptance tests, although, most likely, it has long been defined, for example, in a contract or terms of reference. Nevertheless, I would single out two options for holding this event and call them conditionally: acceptance of the system “according to concepts” and acceptance of the system “according to science”. With the first, everything is clear enough, but it is impossible to describe such a procedure. It can be a complete formality - fun gatherings with invigorating drinks or a real bacchanalia, where the mention of a technical task is something indecent and even offensive. But I would like to dwell on the second option in more detail, perhaps this article will slightly open to novice specialists, and I'm afraid that to some old warriors, the curtain of the sacrament of acceptance tests. I will also try to give some tips so that the tests are more productive.

A little about the standards. In ancient times, as a student, I, like many young people of my generation, was skeptical about the various standards and guidelines of the USSR, while not even delving into their essence. But quite a bit of time passed and common sense took over, I not only apply GOSTs myself, but also recommend them to others for use. Of course, in the GOSTs of the 80-90s there are obvious atavisms, nevertheless, I compare them with the charter of the armed forces, they are what is called "written on blood" and believe me, there are a lot of sensible thoughts. Specialists who know GOSTs, as well as documents drawn up in accordance with GOST and RD, can be seen from afar and they differ clearly for the better.

Acceptance tests are carried out in accordance with GOST 34.603-92 " Information technology. Types of testing of automated systems". This type of testing is final after preliminary tests and trial operation. The purpose of these tests is to check the compliance of the automated system with the requirements of the Terms of Reference and to make a conclusion about the readiness of the System for putting into permanent operation.

Tests are carried out according to the document Program and the method of acceptance tests (TMI). PMI is developed using RD 50-34.698-90 “Automated systems. Requirements for the content of documents. First of all, thanks to this document, acceptance tests "by concepts" turn into acceptance tests "by science". The PMI describes all the requirements (functional and non-functional) of the Terms of Reference and the expected results of the audit.

Council number 1. PMI is the last chance for the Customer to influence the characteristics of the received information system. Especially if in the course of the project a Terms of Reference was developed, which in the classical sense says “what to do” (goals and objectives, General requirements, requirements for software, hardware and documentation, requirements for personnel, etc.) and the Technical Design was not developed, which says “how to do it” (specific technical solutions for the implementation of specific requirements of the Terms of Reference). Allow sufficient time to develop and agree on the Program and Acceptance Test Methodology. If you like, this will be your acceptance test charter.

In addition to agreeing on the PMI, the customer should not forget to issue an order on the composition of the acceptance committee, and familiarize each of its members with the PMI against signature. Whom to include in the commission is a personal matter of the Customer. I recommend that it must have:

• Functional customers
• Representatives of departments - key users of the System
• Representatives of the technical departments that will continue to service the System

And also were not (applies to both parties):

• Weak and unbalanced employees
• Employees who do not listen and express themselves poorly
• Freelancers representing companies of competitors

Council number 2. Do you want everything to be “in an adult way” during the acceptance tests of an automated system? In addition to checking the functional requirements, do:

• Deployment of System software from scratch
• Verification of the declared time indicators of full and partial restoration of the System
• Checking the performance of the System by measuring the execution time of key functions, albeit in exclusive mode. Of course, these indicators must be initially described in the Terms of Reference, or the parties will be doomed to argue that there is a “comfortable time” for performing this or that operation. My subjective opinion has remained the same for many years - up to 3 seconds. to perform basic simple operations, then you need to proceed from specific situation
• Checking the stability and reliability of the System. Even such an elementary test will be quite enough - open the interface form for entering data, pull out the power cord or disconnect the Wi-Fi connection, try to save the data, get an adequate message, restore the connection and try again to save. If this web application is recommended to check the correctness of reloading pages, that is, after opening a particular form / page, after executing the command to save data, etc., force the refresh command (in browsers, this is usually the F5 key)
• Checking the completeness and quality of documentation. It is better to complete this part before the start of the test, because. it takes quite a lot of time. Directly on the tests themselves, announce the results of this test

In general, start by checking the compliance of system-wide software (operating systems, office suites, database management systems, etc.) and technical support Systems (servers, client stations, communication channels, etc.) to the stated requirements in the Terms of Reference. Discrepancies in these paragraphs can become a justified reason for failure to achieve the characteristics of the System to the declared indicators and even complete failure to perform certain functions of the System.

Council number 3. Acceptance tests are carried out on a control data set. The System must be loaded with data at least comparable to the planned volume of data for the first year of operation. Let it be automatically generated information, the quality of the content is not in the first place here. If the required amount of data has already been generated during the trial operation, great.

Council number 4. Often in the Terms of Reference the phrase "The system must ensure the simultaneous operation of N users" is written. The contractor primarily ensures the availability required amount competitive licenses (if such a licensing policy is provided). Do not hesitate to ask how organizationally or technically the fulfillment of this requirement was ensured. If load tests have been carried out (in automated and/or manual mode), ask for a protocol and a program for carrying out. If these tests are launched directly on the tests, honor and praise to the Contractor.

Based on the results of the acceptance tests, a protocol (report) on the test results is drawn up, it may include an appendix describing the identified comments and the timing of their elimination (do not forget about this), as well as an act technical condition System and readiness for its acceptance in commercial operation. The content of these documents is also described in RD 50-34.698-90 “Automated systems. Requirements for the content of documents.

After successful tests, according to the old Russian tradition, the newborn System needs to be “washed”, although I did not find this in any GOST.

(4.44 - rated by 9 people)

No, not like that. It's just that the time is different and the work we have is different.

Previously, there was a customer represented by the state, there was a performer (for example, some kind of research institute), there was a beneficiary - some kind of plant. The customer, of course, wanted that what the performer did corresponded to the initial requirements of the beneficiary. Otherwise, corruption, misappropriation of funds and all that.

Here is a new contract system, which is replacing the 94th Federal Law, and also wants to control the outcome of the work at the exit. There, probably, "acceptance tests" will be required specifically for the customer. For this, the standards will be updated over time (in the legislation customs union this already exists for equipment and machines). And the customer himself will pay for it, i.e. state.

Page 1

Acceptance tests are carried out in accordance with the specified program and methodology upon presentation of the terms of reference for the creation of the AU, work logs, acts of acceptance and completion of trial operation. During these tests, the NPP functioning is checked under the conditions specified in the ToR, autonomously and as part of a complex, as well as checking the means of restoring the NPP operability after failures and the possibility of practically implementing all the recommended procedures. The test protocols for the program are summarized in a single protocol, on the basis of which a conclusion is made about the system's compliance with the requirements of the TOR and the possibility of issuing an act of acceptance of the NPP for permanent operation.

Acceptance tests should be carried out 2 times: primary within 3 months.

Acceptance tests are carried out by testing organizations and departments included in the system government organizations for state tests, or other organizations and enterprises involved by the parent organization to conduct acceptance tests in the prescribed manner with the participation of the manufacturer and developer.

Acceptance tests are carried out to determine the feasibility and feasibility of manufacturing products. Experimental or prototype samples (batches) of products certified by the commission are subjected to tests using certified test equipment.

Acceptance tests are carried out to determine the feasibility and feasibility of putting products into production. Acceptance tests of single-piece production products are carried out to resolve the issue of the feasibility of transferring these products into operation. Experimental or prototype samples (batches) of products are subjected to tests. When delivering a family, range or size range of products for production, a typical representative is selected based on the condition of the possibility of extending the results of its tests to the entire set of products. Acceptance tests are carried out by certified test departments using certified test equipment. The products assigned to the parent testing organizations are checked by these organizations.

Acceptance tests must be carried out on a prototype of an electrical machine, so the scope of these tests is quite large. Yes, for cars. direct current the acceptance test program contains 17 items, for synchronous machines - 22 items, for asynchronous motors - 16 items.

Acceptance tests cannot detect the described software corruption, since it does not affect the design in any way, and the simulator program can detect it only in rare cases, since the range of malicious actions is too large for it to be advisable to implement all possible dangerous situations in the simulator.

Acceptance tests are carried out by departmental, interdepartmental or state commissions after the successful completion of preliminary tests. In addition to the scope of preliminary tests during acceptance tests, the oil consumption or lubrication of cylinders, seals, bearings and the crank mechanism is determined.

Acceptance tests are carried out according to the most detailed programs established by standards or specifications for this type of machine. Their goal is to check the compliance of manufactured machines with all technical requirements. Acceptance tests are subjected to prototypes - the first industrial samples of machines of this type, produced by the enterprise. The number of samples that must be taken for acceptance testing is established in the standards or specifications for given type machines. All subsequent machines must be produced by the enterprise without changing the design, technology or materials used for the manufacture.

Acceptance tests are carried out in order to identify the actual performance of the machine, as well as to establish the correct operation of the components (gears, bearings, brakes, etc. Acceptance tests are carried out on a test site under conditions close to operational ones. The test results are recorded in the machine passport. If during the test, defects, they are recorded in the defective statement and then eliminated.

Acceptance tests are carried out to verify the performance guaranteed by the equipment supplier. The program of these tests usually provides for a series of balance experiments of increased accuracy under conditions that are subject to verification in accordance with the supplier's warranty data.

Acceptance tests are official tests in the presence of a commission, based on the results of which a conclusion is made about the advisability of starting mass production, and for pumps individual production- commissioning. At the same time, parametric indicators and characteristics of the pump obtained during testing are determined and included in the documentation. In the future, according to these indicators and characteristics, taking into account tolerances quality control of serial pumps is carried out.

Acceptance tests establish the compliance of the actual performance of the machine with the specifications and are carried out on special stands in conditions that are as close as possible to operational ones.

Acceptance testing of machine tools in accordance with the general specifications for their manufacture and acceptance, they are carried out at idle to check the operation of mechanisms and under load to determine productivity, accuracy and cleanliness of processing. During the test, all switching on, switching and transmission of controls are checked to determine the correctness of their action, interlocking, reliability of fixation and the absence of spontaneous displacements, the absence of jamming, cranking, etc.

Acceptance testing is one of the milestones building a new car. Their purpose is: a comprehensive performance test prototypes in a variety of road and climatic conditions according to the terms of reference for the development (including in a hot climatic region and a cold one); determination of the actual values ​​of all the most important parameters; identification of the reliability of the car as a whole, as well as its main components, assemblies and systems; establishing the degree of compliance of the created car with the intended purpose and determining the feasibility of putting a new model into production. On average, two to four samples are submitted for acceptance tests. Tests include carrying out a significant number of laboratory and laboratory road works to determine the technical and operational indicators and mileage of vehicles in all typical conditions of their intended operation.

The development of CD and TD, and, if necessary, program documentation, is carried out according to the rules established by the standards of the Unified System for Design Documentation (ESKD), the Unified System for Technological Documentation (ESTD) and the Unified System for Program Documentation (ESPD).

Design management must meet the requirements of 4.4 GOST R ISO 9001. If the first model is implemented, then in accordance with NPB 180-99, at the request of the GUGPS, the developer (manufacturer) develops a technical design (the requirements for the technical design are set out in GOST 2.120-73 ESKD. Technical design) , which coordinates with GUGPS and VNIIPO. When implementing the second and third models, the decision on the need to develop a technical project is made by the customer or developer.

Regardless of the implemented model, the rights to the developed DD are determined by an agreement between the customer and the developer (manufacturer and manufacturer). The solution of the issue of the rights to the design documentation is one of the key in the development and production fire fighting equipment. When implementing the first and second models, it is more profitable to leave the right to a CA to the customer (SBS structures). This allows the customer (SBS structures) to decide whether to issue or revoke a license for the manufacture of PA, create competition when transferring design documentation to a new manufacturer, thereby influencing the manufacturer or manufacturer. If the rights to the design documentation belong to the State Fire Service, then this allows placing orders for the manufacture of already developed PAs at enterprises that meet the requirements of the State Fire Service. Otherwise, when changing the manufacturer, it is necessary to re-develop the design documentation, which takes a lot of time and is associated with significant material costs. A similar situation has already arisen in the history of the production of fire equipment in Russia: during the separation of Ukraine, it was necessary to re-organize production, and therefore, design documentation and TD for PA, similar to those PA that were produced at the plant in the village. Frankincense Pryluky district of Chernihiv region.

To confirm the compliance of the developed design documentation with the TOR, an experimental or prototype PA is made: an experimental one for mass production; head - for non-serial. When creating a single PA, the main sample, as a rule, is subject to sale to the customer. A prototype or prototype PA is subjected to control and testing procedures in accordance with the requirements of 4.10 - 4.12 GOST R ISO 9001. The scope and content of the tests necessary to prevent the production of unused, non-compliant products are determined by the developer, taking into account novelty, complexity, features production and application of PA, as well as customer requirements. At the same time, tests must be carried out for compliance with all requirements of standards and normative documents bodies exercising supervision over compliance with safety requirements (SSBT standards) and nature protection.

In accordance with GOST 15.201-2000 and NPB 180-99, an experimental or prototype PA is subjected to the following types of tests: preliminary (factory), acceptance, operational.

Preliminary (factory) tests are organized by the R&D performer for the purpose of preliminary assessment of the compliance of the prototype or prototype of the PA with the requirements of the technical specifications, as well as to determine the readiness of the prototype or prototype of the PA for acceptance tests. Tests must be carried out by the manufacturer (manufacturer) of the PA or a specialized organization licensed to conduct this type of test. The composition of the commission of preliminary tests is formed by the manufacturer of the PA on the basis of an order issued by him. The commission should include representatives of the manufacturer (developer and manufacturer) and the State Fire Service. The program and test methodology are developed by the manufacturer and coordinated with the GUGPS and VNIIPO. Preliminary tests should include combat deployments in order to determine the time of their execution. Schemes of combat deployments are selected in accordance with the Manual on fire drill.

Materials of preliminary (factory) tests as part of the TOR, draft specifications, test programs and methods, act of preliminary (factory) tests are sent to the customer for consideration to resolve the issue of organizing acceptance tests. When implementing the first model in accordance with the requirement of NPB 180-99, the listed materials are sent to the GUGPS and VNIIPO.

When creating a PA for the first model, state acceptance tests are organized and carried out, for the second and third models - acceptance tests with the participation of the relevant authorities state supervision and other interested organizations. State acceptance tests in accordance with GOST 15.201-2000 are organized by the state customer, unless otherwise stipulated by the agreement (contract). The peculiarity of the state acceptance tests of the PA is that, according to NPB 180-99, the composition of the commission for the acceptance of the PA is formed in agreement with the GUGPS by the manufacturer (manufacturer), who issues the appropriate order for the organization. A representative of the GUGPS is appointed as the chairman of the commission, in agreement with which the place and time of the acceptance tests are appointed.

Acceptance testing of PA prototypes according to the second and third R&D models in accordance with GOST 15.201-2000 is organized by the PA developer. When implementing the second model, the composition of the commission is formed by the customer together with the developer, the chairman of the commission is a representative of the customer, unless otherwise stipulated by the agreement (contract). In the case of R&D in case of initiative development (without a specific customer), acceptance tests are organized by the developer, and the acceptance committee, as a rule, is formed from representatives of potential PA consumers, State Border Service structures, state and supervisory authorities.

Regardless of the implemented model, the responsibility for conducting acceptance tests lies with their organizer. According to GOST 15.201-2000, with the consent of the interested parties, it is allowed to carry out acceptance tests without appointing a commission, but with the assignment of its functions and duties to the relevant services of the organization conducting the tests, which should be reflected in the TOR and (or) agreement (contract) for the implementation of R&D. In carrying out acceptance tests, regardless of the place of their conduct, the manufacturer and state supervision authorities (OGN) are entitled to take part, which must be informed about the upcoming tests one month before they begin. All GGN defined by the current legislation for this product either participate in acceptance tests or give conclusions based on the test results. In the absence of a representative of the OGN or his opinion, they consider that the OGN agrees to accept the products or is not interested in it.

The acceptance committee for NPB 180-99 is presented with: a prototype PA, completed in accordance with the statement of work; technical task; test program and methodology; act of preliminary (factory) tests with test reports; design documentation (letters "O").

The test program is developed on the basis of the requirements of the TOR, design documentation using standard programs, typical (standardized) methods set out in prescriptive documents. The test program includes: test object (experimental or prototype PA); the purpose of the tests; scope of tests; conditions and procedure for testing; logistics of testing; metrological support of tests; test reporting. The program and methodology for acceptance testing should include checking the quality of the working design documentation and operational documentation in order to make a decision on the suitability of the documentation for industrial production.

The test methodology includes: evaluated characteristics (properties, indicators) of PA; conditions and procedure for testing; methods of processing, analysis and evaluation of test results; used means of testing, control and measurement; reporting. If non-standardized methods are used, then they should be consistent with the relevant GGN.

Based on the results of the acceptance tests and consideration of the submitted materials, the commission draws up an act in which:

1. Establishes compliance of the sample of the developed (manufactured) PA with the requirements of the TOR.

2. Gives an assessment of the technical level and competitiveness of the PA, including in the patent and legal aspect.

3. Evaluates the developed technical documentation (including the draft specifications).

6. Makes comments and makes suggestions to improve the PA and documentation.

According to GOST 15.201-2000, the act of the acceptance committee is approved by the customer. Approval of the act of the acceptance committee, containing a positive assessment, means the end of the development; termination of the TK; approval of the submitted specifications, technical documentation. According to NPB 180-99 acceptance certificate prototype A PA containing a positive or negative assessment of the development results is approved by the chairman of the commission. Moreover, if there are comments that require additional testing, refinement of the prototype, changes to the documentation, the chairman of the commission has the right to decide on the approval of the act after the comments are eliminated. At the same time, members of the commission who disagree with general assessment developments, indicate in the act a dissenting opinion with its justification.

Operational tests of a prototype or prototype UA are carried out in the State Fire Service in accordance with the Technical Service Manual. Training of personnel to work on the PA is carried out by the manufacturer (manufacturer) of the PA. Based on the test results, the State Fire Service specialists prepare a conclusion in which they indicate: data on the operation of the PA for the period of operational tests (an extract from the register of the presence, operation and movement of motor vehicles); information about PA malfunctions (extract from the maintenance log); assessment of the completeness and convenience of the placement of the fire extinguishers, as well as a proposal for additional configuration of the fire extinguishing equipment and changing the placement of the fire protection equipment; schemes and conditions for conducting combat deployment and the time of their implementation; assessment of the running properties of the PA
(see chapter 6 of the textbook); compliance with the performance characteristics of the PA for the combat missions being performed; the effectiveness of the use of PA in the performance of combat missions.