The ABC of Qualimetry. The Toolkit for Measuring Immeasurable

1.1.3. The Origin, Growth and Future of Qualimetry

1.1.3.1. The Reasons Behind the Rise of Qualimetry as a Science

Qualimetry is a consequence of knowledge quantification

The term qualimetry (from the Latin quale, “of what kind”, and the Greek μετρεω, “to measure”) was initially applied to a scientific discipline studying the methodology and problems of quantitative assessment of the quality of various objects, mainly of industrial products [3]. By 1970 enough experience had accumulated to permit a thorough investigation of qualimetry, its subject matter and its relations with various scientific fields. At the same time there was a growing awareness of the need to expand the scope of qualimetry from product quality (which was the focus of some researchers) to the quality of objects of whatever nature, including socio-economic objects such as the quality of life.

When the term (and the respective concept) was first used it seemed unexpected, almost fortuitous; some still regard it so.

However, it would be wrong to speak of the fortuity of qualimetry. On the contrary, its appearance should be seen as one of the many perfectly natural signs of the general broadening of the scope of quantification and the use of quantitative methods in scientific and, generally, cognitive activities at large.

The universal and imperative nature of this tendency to expand the use of quantification as a major tool of cognition was succinctly stated by Galileo, who said “Measure what is measurable, and make measurable what is not so.” The Russian Mathematician D. B. Yudin expressed nowadays essentially the same idea: “Quality is a yet unknown quantity”.

Many great minds were aware of the important influence that mathematics, as a general framework of quantification techniques, has exerted on the development of science.

K. Marx was of the opinion that a subject could be called a science if it had a mathematical foundation. A century before him, I. Kant wrote in his Metaphysical Foundations of Natural Science, “I maintain, however, that in every special doctrine of nature only so much science proper can be found as there is mathematics in it”. Three centuries before Kant, Leonardo made a similar statement: “No human investigation can be called real science if it cannot be demonstrated mathematically”. Five centuries before Leonardo, in the 9^th century, the famous Arab scientist Abu Yusuf Ya’qub ibn Ishaq al-Kindi, who saw in mathematics the basis and prerequisite of all science, including philosophy and natural history, pursued a similar line of thought. Another thirteen centuries earlier the Greek philosopher Xenocrates of Chalcedon expressed the ancients” idea of mathematics in the following maxim: “Mathematics is the handle of philosophy”. Dozens of years before Xenocrates, or 2300 years before our time, his teacher Plato said, “Exclude from any science mathematics, measure and weight, and it is left with very little”.

Quantification is steadily broadening its scope of application, as evidenced by the growth of scientific disciplines or technical problem solving techniques that include the Greek μετρεω in their name. Here are a few examples:

Absorptiometry; autometry; autorefractometry; adaptometry; axiometry; actinometry; algometry; amperometry; angiostereometry; anthropometry; astrocalorimetry; astrometry; astrophotometry; audiometry; acidimetry; batimetry; biometry; bibliometry; veloergometry; visometry; viscosimetry; gigrometry; hygrometry; hydrometry; glucometry; gravimetry; gradiometry; densitometry; didactometry; dilatometry; dynamometry; dielectrometry; dosimetry; dopleometry; isometrym impedancemetry; inclinometry; interferometry; cliometrics; calipometry; calorimetry; chelatometry; conductometry; craniometry; coulometry; lipometry; luxmetry; mediometry; mercurimetry; morphometry; scientometrics; nitritometry; optometry; ordometry; oscillometry; optometry; perimetry; pirometry; pH-metry; planimetry; polarimetry; psychometrics; potentiometry; pulseoxymetry; radiometry; radiothermometry; redoxmetry; roentgenometry; refractometry; sensitometry; sociometry; spectrometry; spectroradiometry; spectropolariometry; spectrophotometry; spirometry; spiroergometry; stabilometry; stereometry; sphincterometry; tacheometry; tensometry; technometry; tonometry; turbidemetry; uroflowmetry; fluorimetry; photogrammetry; photocolorimetry; photometry; chronometry; equilibriometry; econometrics; exponometry; electrometry; echobiometry. Qualimetry is also a member of this steadily expanding family. (It would be wrong, however, to believe that every discipline using quantification has metry / metrics in its name.)

Qualimetry: A Tool for Enhancing the Efficiency of Any Kind of Work

What happened for the qualimetry to appear in the 1960s?

Modern management science has formulated five necessary and sufficient conditions for the success of any work, which can be represented by a “condition tree” (Figure 1).

Figure 1. Necessary and sufficient conditions for the success of any work

Four of these conditions, TO KNOW, TO BE ABLE, TO MANAGE, and TO MOTIVATE, are relatively easy to meet technically; regulatory documents for respective calculations are already in place. For example, every productive industry uses its own rate setter’s handbook (or a similar document), which is used to calculate the workforce and the time and tools needed to perform a piece of work (TO MANAGE condition). Other documents, like wage rate books, specify the requirements to be met in selecting the workforce to do some work successfully (TO BE ABLE condition).It is relatively easy to secure the TO KNOW condition: you only need to set the work executors a task. Finally, to meet the TO MOTIVATE condition all businesspersons or managers have a broad range of stimulatory actions they can use on their subordinates: material or moral; positive (“carrot”) or negative (“stick”); individualized or team-directed; one-off or time-phased, etc.

The TO EVALUATE condition is a very different case. What we evaluate is work. Any work (and its output) is characterized by three parameters: quantity, cost and quality. Arguably, the numerical evaluation of the quantity and cost parameters does not present any essential difficulties to most occupations in the real sector.

We have a different situation with the quality parameter. Here two aspects must be taken into account: the quality of individual labour and the quality of teamwork. As for individual labour, evaluating is just a trivial task (particularly if it is to be done in a quantitative form and with due regard for the many characteristics that constitute its quality).

Evaluating even the simple labour of an industrial worker poses difficulties: it is by no means always that it can be evaluated using a simple reject rate index. These difficulties multiply when it is a matter of quantitative assessment of the quality of complex labour, e.g., brainwork.

Here is an example to illustrate the importance and complexity of this task. Back in the early 1970s a group of UNESCO experts surveyed 1200 research teams in Austria, Belgium, Finland, Hungary and Sweden. Their conclusion: the most vexed problem in raising working efficiency in science is the lack of a reliable methodology for assessing the quality of work of individual researchers and research teams. (Similar examples can be cited with respect of managers, health professionals, engineers, teachers, administrators, and some others.).

Let us now look at the issue of assessment of the quality of teamwork. It stands to reason that the quality of output is its most important characteristic. As already mentioned, the outcome of any teamwork is, a product, a service, some information or energy. Of these four the product is by far the most complex in terms of the quality assessment method and the most important in terms of the breadth of its existence domain, given that more than twenty million kinds of products are manufactured by developed economies over the world.

It all goes to show that:

1. In the present-day context, successful, i.e. effective, productive work is a key condition of the economic health of both an individual company and a country at large.

2. When we address the problem of increasing the success/efficiency of any labour the key element is the quantitative assessment— both of the process and the outcome of labour; primarily its product.

3. Of the three characteristics of labour (and its outcome) – quantity, quality and cost – quality is the most complex one in terms of quantitative assessment.

4. Until quite recently, the approach to the problem of quantitative assessment of quality (primarily of products) lacked sound methodological support. At best, isolated quality quantification techniques were created, which had not any sound and unified rationale to support them. As a result, different quantifications of the quality of the same object could be worlds apart if calculated by different methods.

5. A natural corollary to propositions 1—4: in the early post-WWII years every industrialised country felt the need for scientific rationalisation of methods of quantitative assessment of the quality of production work and its outcomes.

6. It was F. Engels who noted that when a technical need appears in society, it pushes science forward faster than a dozen universities. The origins of qualimetry can be seen as a natural response to a pressing need for generalisation and perfection of the techniques of quantitative assessment of quality.

1.1.3.2. History of Qualimetry: From Aristotle to Our Times

Theoretical Reason for the Relatively Late Origin of Qualimetry

One may ask: why did qualimetry appear as an independent scientific discipline in the 1960s and not before?

There were two principal reasons.

The first, which we will tentatively call “theoretical”, is as follows. The term quality has existed in science for as much as 2500 years, since the days of Aristotle. His usage of the term referred to different concepts. (For convenience, hereafter the respective definitions for these concepts will be given a modern interpretation, in a concise form, which are more familiar and comprehensible than Aristotle’s definitions. – Auth.). Subsequently, it was depending on its interpretation that it was decided whether or not it was necessary and possible to quantify/estimate this concept.

Interpretation I: Quality is an essential certainty of an object (i.e., a thing, phenomenon or process), which makes it what it is and not something else. In other words, quality is the kind of certainty that distinguishes, say, a human from a horse or a table.

This interpretation was dominant for centuries and it was not until the 20^th century that it gradually started to fall into disuse; today, it is of interest almost exclusively to professional philosophers. Clearly, in most cases it makes little sense to refer to this interpretation of quality quantification or estimation; possible exceptions may be biological taxonomy or computer-based pattern recognition.

Interpretation II: Quality is an essential feature or property characterising a given object. Or, as Aristotle said, “… for example, warmth and coldness, whiteness and blackness, weight and lightness, and likewise other similar definitions…”

Quality in this sense has long since been successfully quantified using tools of general sciences like metrology or commodity research of special sciences such as gravimetry, dosimetry, calorimetry, etc.

Because the contemporary literature of science and engineering is trying to get rid of polysemantic terms the second interpretation has all but grown out of use. The term property has come to replace quality, which fact was embodied in the U. S. S. R. State Standard (GOST) for product quality terminology back in the 1970s. Therefore, the above interpretation of the term quality has no direct relevance to our present discussion of quality quantification.

Interpretation III: Quality is the totality of properties of an object that become apparent during its intended use (operation, application or consumption).In other words, quality is a characteristic of an object such that if it is quantified it would allow, with the simultaneous recognition of all the properties of the object in quantitative terms, to measure the goodness of the object when used (operated, applied or consumed).

This interpretation echoes another interpretation of Aristotle’s, who believed that the term quality could be, applied “… in relation to a good and a bad course of action and, generally, both good and bad belong here.”

This, third, interpretation has become the prevailing, almost exclusive one. That is due primarily to the scientific and technological progress in industry, when an enormous variety of similar products appear around the world every year, as well as to the rapid growth of international trade in products, services and energy.

Naturally, after this interpretation became well established and then almost exclusive the need was felt for numerous quality measurement techniques, and as a consequence, for a special discipline to give a scientific justification to such techniques. Before the twentieth century the third interpretation had found very little use; accordingly, there had been little use for quality assessment; hence, no need for qualimetry.

Above we considered the “theoretical” reason for the relatively late origin of qualimetry as a general method for quality quantification. (Late, that is, in comparison with the origins of the methods of measurement of the two other characteristics of any production output; quantity and cost.)

Practical Reason for the Relatively Late Origin of Qualimetry

There is a second reason, which we tentatively call “practical”. Its nature can be educed after we answer the question: Why qualimetry as an independent science was born as late as the mid-20^th century if early quality quantification methods had appeared in and outside Russia already in the early twentieth century? We shall try to answer this question by drawing upon materials from the history of domestic science and engineering.

In Russia, the well-known mechanic and shipbuilder A. N. Krylov developed the first scientifically grounded quality measurement method back in the 1910s. He used it to solve the problem of choosing the best warship design from the many submitted to an international competition. (The best here refers to the totality of main properties, or quality, e.g. speed, protection, gun power, etc.). That selection was necessary for the restoration of the Russian navy after the heavy losses it sustained during the Russo-Japanese war.

Unfortunately, the Krylov method – which retains its importance among the many other qualimetric techniques to this day – upon development and successful application fell into oblivion, perhaps because it was designed for appraising the quality of rather unique objects, warships; a description of it could be found in a relatively obscure, almost rare publication (see [4]).

Some 20 years after Krylov’s method other methods for assessing the quality of different types of products appeared. They used a very different approach: where as warships were evaluated by the so-called “analytical” (i.e. non-expert) method, here a kind of expert approach was used. These methods began to evolve from the late 1920s, when the Special Council on Product Quality under the Presidium of the Supreme Economic Council of the U. S. S. R. found it necessary to use quality indices as an important tool in promoting technological progress and improving product quality. The reference was not to indexes of particular properties but to general (complex) parameters characterising product quality in general.

An essentially similar approach was used to assess the quality of some processes, for example, the performance of a printing shop. At the same time, so-called “comparative quality factors”, which had a regulatory character, were developed for some consumer products.

In the 1930s, the scope of application of expert methods for quality estimation expanded and they were incorporated in some industries and national standards as well as in departmental guidelines. For example, the first half of the 1930s saw the development and application of methods for evaluating the quality of some foodstuffs such as butter, canned fish, bread, confectionery and dried vegetables.

Similar techniques were developed not only for food products but also for consumer goods, such as cotton yarn, fabrics and textile goods, and for evaluating the quality of industrial products, e.g. tractors and farm machinery.

Quality measurement methods multiplied after WWII, in the 1950s. However, qualimetry did not emerge as an independent scientific discipline yet. Apparently, a general pattern relating to the conditions leading to the appearance of a new research topic was at work. Indeed, history shows us that before a knowledge field receives the status of a science there is a latent period when some of its principles and methods are generated and put to test. It is followed by the accumulation of a large body of unsystematised empirical data. At the same time the need may be felt for conceptualisation of the previous experience of generating those data and addressing emerging problems. The preconditions for a theoretical foundation of a new science are thus created. So emerged geometry in the ancient world. So emerged cybernetics, bionics, semiotics, operations research, econometrics, ergonomics, ecology, etc., in today’s world. So, again, it was in 1968 that qualimetry began to grow into a fully-fledged scientific discipline [3].

More recently qualimetry split into two separate branches or independent disciplines— applied qualimetry and theoretical qualimetry, which are briefly described below.

Theoretical Qualimetry

Qualimetry has evolved one more branch, theoretical qualimetry, which explores general methodological issues and problems of quantitative estimation of the quality of an abstract mathematical object rather than that of any particular objects (things, phenomena or processes). The rise of theoretical qualimetry served as a decisive argument in favour of making qualimetry into an independent scientific area. The fact is that an overwhelming majority of the quality evaluation methods that were proposed in and outside Russia before 1968 lacked of any comprehensive scientific justification and constituted, in effect, a mass of empirical data wanting analysis, justification and generalisation. (The only exceptions were the Krylov method and a 1928 paper by the Russian philosopher and theologian P. A. Florensky, dedicated to one of the problems of quantitative estimation of quality [5]).

An almost similar situation in the field of quantitative estimation of quality evolved elsewhere.

Then came a time when someone had to recognise the need for analysing, rationalising and generalizing the wealth of accumulated empirical material within a separate scientific discipline. Recognition could come somewhat earlier or somewhat later but it was bound to happen at around that time, in the 1960s or “70s.

Applied Qualimetry

This discipline seeks to develop applied techniques for evaluating the quality of new, here therefore unevaluated types of objects (things, phenomena and processes). The essence of this type of qualimetric research is described by the term applied qualimetry, which is one of the two branches of qualimetry as an independent scientific discipline. In this respect there appeared different sub disciplines, such as geographical qualimetry, automatic-machine qualimetry, construction engineering qualimetry, educational qualimetry, geodesic qualimetry, fabric qualimetry, etc.

Qualimetry Institutionalised

It happened that the first to arrive at this idea was a group of Soviet scientists (economists, civil engineers, car makers, architects), who were dealing with the problem of quantitative evaluation of quality. Gathering at an informal workshop in Moscow in November 1967, they came to the following conclusions:

1. The group members (Azgaldov, Glichev, Krapivensky, Kurachenko, Panov, Fedorov and Shpektorov) as well as some other researchers working on similar tasks were doing the same thing in terms of methodology, namely, trying to quantify quality, albeit in relation to quite different objects.

2. In their pursuits they faced almost identical scientific problem, and they used tools based on some common and similar concepts.

3. To achieve success in solving these problems and to improve the tools used it was advisable to bring together researchers engaged in quality evaluation in both the U. S. S. R. and abroad.

4. Such a pooling of efforts could best be achieved in the framework of a joint research activity that met all the conditions qualifying it as an independent scientific discipline.

5. The most suitable name for that discipline was qualimetry. Indeed, the Greek root metreo has become commonly accepted in the international lexicon of science. As for the Latin root qualis, its derivative words in the majority of the languages accounting for the bulk of scientific and technical literature means “quality” (cualidad in Spanish, qualità in Italian, kwaliteit in Dutch, Qualität in German).

Therefore, the term qualimetry is quite handy: it is concise and it accurately renders the scope of the “quality measurement” concept; its main components are intelligible to people speaking different languages; its structure makes it easy to form any derivative words like qualimetrologist (a qualimetry scientist), qualimetric approach (quality measurement approach) etc.

Furthermore, this term is part of a logically consistent system of concepts and terms; e.g., the science of quality (qualilogy) and the related science of quality measurement (qualimetry);one can draw an analogy with some other sciences: economics – econometrics, biology – biometry, psychology – psychometrics.

A paper by the workshop participants, which substantiated the above five propositions, was published in the journal Standarty i kachestvo [3]. It provided content for an international discussion in the journal during 1968, in which an overwhelming majority of the contributors supported the idea of a new scientific discipline. Thus qualimetry was born.