2023 Netcom Independent Innovation Research Report - Software Testing Tools

Chapter X

Software testing tools

"2023 NCIT Independent Innovation Research Report"

There are many categories of software testing tools that play a vital role in the software development process. At present, the independent software testing industry has entered a stage of accelerated development, and related products have been put into the market one after another, but on the whole, the market share needs to be improved.

10.1

Autonomous software testing tools

Facing challenges on the market side

10.1.1

There is a gap in the autonomous software testing tools themselves

Like other basic software, there are few users of independent software testing tools, which will inevitably lead to less feedback on use, and then slow update and iteration in terms of product ease of use, reliability, stability, etc., resulting in the maturity of domestic software testing tools is generally not high. In addition, the localization of software testing tools for the domestic market is not strong enough, although to adapt to a large number of localization environment, but really developed in the localization environment, for the domestic market demand of the product is not many. Finally, domestic manufacturers focus on software subjects and ignore supporting materials, resulting in a large gap in software manuals, online help, learning materials, secondary development interfaces, etc.

10.1.2

Autonomous software testing tools

The market size was not formed

First of all, the gap in features, performance, and stability is the root cause of low market acceptance. Secondly, the industry dominated by B/S architecture generally emphasizes the quality of software use and ignores the internal quality of software. The quality of software use is more dependent on black-box dynamic testing, resulting in artificially less important software code analysis tools. In addition, due to the lack of unified standards, there are differences in data formats among independent software testing tools on the market, which makes it difficult to get through to tools and data compatibility, which further makes it difficult for the entire industry to form a scale effect. Finally, foreign open source software testing tools have a great influence on software testing practitioners, and have also caused a certain degree of impact on independent software testing tools.

10.1.3

Industry perception of software testing

There is a big difference

The use of code static analysis tools, unit/integration testing tools, functional automation testing tools, interface testing tools, and performance testing tools has been basically recognized in the whole industry, and has been applied to varying degrees in the software engineering process. All-digital simulation test system, hardware-in-the-loop simulation test system, FPGA test tools are only used in some industries.

Some industries have paid more attention to domestic software testing tools, but there is still a lack of awareness across the industry. In the government, finance, Internet, telecommunications and other fields of users' understanding of software quality still stays in the quality of software use, the lack of industry consensus of high-quality software coding specifications, software unit testing/integration testing third-party evaluation system, the use of software testing tools are mainly foreign products or open source tools, domestic software testing tool manufacturers in these industries market share is almost zero.

10.2

Autonomous software testing tools are required:

Resource investment and multi-dimensional support

10.2.1

On the basis of foreign tools

Imitation or improvement

Software testing tools have typical industrial software attributes, which have the characteristics of small volume, high concentration, difficult development, long development cycle, large capital demand and slow effect. Because of these factors, the number of vendors who are really focused on developing these tools is smaller. At the same time, the domestic software testing tool market is fragmented, the R&D ideas are relatively conservative, and the R&D resources are limited, resulting in the domestic testing tools are mostly imitated or improved on the basis of foreign tools, and lack of originality. In addition, due to the lack of unified standard specifications, there are great differences in performance, function and reliability between different brands and models of software testing tools.

10.2.2

There is a lack of policy traction and standard support

In the current market environment, domestic independent software testing tools are facing the reality of insufficient industry support and guidance. First of all, the certification and accreditation bodies in the industry have not yet widely adopted domestic independent software testing tools when promoting the work, resulting in the lack of necessary recognition of domestic tools at the origin stage and unable to play their due traction role. Secondly, the evaluation standards of domestic software testing tools are not yet perfect, and there is a lack of authoritative evaluation system, which makes it difficult for domestic software testing tools to win the trust of users with their own strength in the face of international competition. Finally, the benchmark position of foreign software testing tools in the industry is too strong, and under the same conditions, users tend to choose foreign tools.

Due to the fierce competition in the market, many manufacturers have adopted some unfair competition methods in order to compete for market share, such as cladding, ultra-low price competition, etc. These behaviors have undoubtedly disrupted the market order and further led to many domestic brands being at a disadvantage in the competition.

10.2.3

There is no effective synergy with the information and innovation system

The development of the information and innovation industry cannot rely on foreign tools, but should actively promote the application and development of domestic independent software testing tools. However, limited by its own maturity and adaptability, the quality and safety guarantee of independent software testing tools for Xinchuang products is insufficient, which is mainly manifested in: first, the technology is immature, resulting in the unstable performance and imperfect function of the test tools: second, the degree of standardization is not high, resulting in difficulties in data exchange. Third, the ecological environment is immature, resulting in the lack of effective integration of independent software testing tools with the information innovation system, and the lack of research and development for the needs of the information innovation system, and then the quality problems of the software in the information innovation system cannot be efficiently solved.

10.3

Establish efficient authority

Ecosystem of software testing tools

10.3.1

Improve the advancement and maturity of products

Enhance technological innovation capabilities, strengthen research on key basic technologies, and promote technological innovation in independent software testing tools. Through the introduction of new technologies and new methods, the automation and intelligence level of testing tools are improved, manual intervention is reduced, and testing efficiency is improved. On the one hand, we will increase R&D investment in the core algorithms of software testing tools, break through various key software testing technologies as soon as possible, continuously reduce the false negative rate and false positive rate of code defect detection tools, strengthen the integration with integrated development environments, software engineering tools, product data management systems and other platforms, and comprehensively improve the performance, reliability, ease of use, standard compliance and operation and maintenance capabilities of domestic tools; On the other hand, it improves the adaptability with the domestic basic software and hardware environment, continuously adapts to the characteristics of the software engineering process of various industries in China, organically integrates domestic software testing tools into the software research and development and generation process of various industries, and better provides users in various industries with multi-scenario use methods through the combination of solutions, products and technical services.

At the same time, it is necessary to strengthen the protection of intellectual property rights, protect the achievements of innovation, and encourage technological research and development and innovation.

10.3.2

Promote the construction of standards and certification and testing

Refer to international standards and industry best practices to develop software testing tool evaluation standards suitable for national conditions. These standards should cover aspects such as functional performance, ease of use, stability, security, etc., to ensure a comprehensive and objective evaluation of the quality of software testing tools. At the same time, we pay attention to formulating and improving the standard system of independent software testing tools and information innovation system, strengthen product certification and testing, improve product quality and reliability, and enhance market competitiveness.

10.3.3

Strengthen the integration of the industrial chain,

Serve the information and innovation industry

Strengthen the integration of the industrial chain, strengthen the cooperation and exchange of upstream and downstream enterprises in the industrial chain, and form an industrial ecological chain. Through the integration of industrial chain resources, improve the market share and competitiveness of products, realize the coordinated development of information and innovation system and independent software testing tools, and jointly promote industrial upgrading. Specific measures may include: First, setting benchmarks. Select representative information and innovation enterprises and projects as the application benchmark of independent software testing tools. The second is to gradually promote. Strengthen exchanges and cooperation with information and innovation enterprises and projects, and expand the visibility and influence of independent software testing tools. The third is to strengthen coordination. Manufacturers of independent software testing tools should have an in-depth understanding of the needs and trends of the information and innovation industry, establish close cooperative relations with information and innovation enterprises, and jointly promote the application and popularization of independent software testing tools in the information and innovation industry.

10.3.4

Strengthen the cultivation of talents

In order to promote the development and application of domestic independent software testing tools, it is necessary to strengthen the cultivation and introduction of talents, improve the compound ability of talents, and promote the gathering and flow of talents. The first is to establish cooperative relations with colleges and universities to jointly promote the popularization and application of domestic software testing tools in teaching. The second is to develop special tutorials for domestic software testing tools for students and practitioners to learn and practice. The third is to build laboratories with colleges and universities to provide equipment and environment for domestic software testing tools for students to carry out practical activities and improve their practical ability. The fourth is to hold a software testing competition to improve students' software testing skills through the competition, and at the same time increase the understanding and trust of domestic tools. Fifth, provide technical support and training to help practitioners better understand and use these tools. Sixth, we will cooperate with universities and research institutes to explore new testing technologies and methods to promote the development of software testing.