Saturday, October 27, 2018

LENS TESTS - DO THEY REALLY TELL US WHAT WE WANT TO KNOW?




50 APO M MTF 


A large number of test reports on cameras and lenses can be found in many camera magazines and on the internet, and it seems that in many cases these are more confusing than helpful.  Owners of Leica equipment often wonder why their supposedly superior equipment in some cases does not perform to their high expectations.  The reasons are diverse and difficult to explain.

As we all know, a modern photographic lens is an immensely complicated instrument, with a great number of performance characteristics.  For years, photographers have tried to find a valid method to determine the overall performance of a lens.  Unfortunately, it is almost as difficult to measure true lens performance as it is to design the lens in the first place.  The emphasis here is placed on “true” performance.

Many readers of magazines and the internet are misled to consider resolution as a valid measure in determining the quality of a lens.  The obvious argument is that a lens must be good if it is capable of high resolution.  Unfortunately, resolution is not a very good measure, especially if it is taken alone and at face value.  This is the very reason why some test reports also publish contrast figures.  The contrast level of a lens is at least as important for overall performance as the resolution.  As a matter of fact, in the past Leica has at times sacrificed overall resolution of lenses in order to gain a higher contrast level.  Contrast is a very difficult to explain criterion.  In simple terms, it can be referred to as the ability of a lens to reproduce high resolution at a recognizable level.  This is not the same as increasing the contrast of a photograph.  Lack of contrast of a lens cannot be corrected by any printing technique or digital manipulation.

Virtually all resolution tests are done with high contrast (black and white) targets which make it very easy to differentiate between minute details.  The results are expressed by lines per millimeter, l/mm, where each black or white line is counted as line pairs per millimeter, lp/mm, where one black and one white line are counted as one line pair. Actual picture taking is different, however, because a lens is rarely subjected to the ideal conditions of a test target.  Instead the lens is confronted with multicolored scenes or subjects, all of which need to be distinguished.  Regardless of photographing in color or black and white, a photographic lens must (in most cases) reproduce a colored subject or scene.  A lesser lens might very well reproduce two almost identical shades of the same color as one color or the same shade of gray, and thus not be able to resolve this slight difference at all, while a better lens will be capable of making that distinction.  On the other hand, in a common lens test, when confronted with high contrast test targets, the lesser lens will inevitably show a higher resolution than it is capable of under everyday conditions.

 

This is a perfect example showing the importance of contrast over resolution.  When viewed from a normal distance of approximately two feet, the bottom picture will immediately look better.  Upon closer inspection one will notice, however, that the actual resolution of the top picture is substantially better.  This can be seen especially by the small test targets in the center.  The actual resolution of the bottom picture is only 50% of that on the top.  Yet the substantially higher contrast of the bottom picture immediately gives the impression of a better image, even higher resolution.  As I pointed out, a pure black and white target will show relatively high resolution, even with a low contrast lens.  Had the center target been separated only by different shades of gray and white, rather than black and white, the differences would not have been visible, in spite of the relatively high resolution as displayed by the top image.  This is a rather extreme example.  Differences from one lens to another rarely are as great as in this example.

 
The gradual disappearance of detail with low contrast subject matter

For that and a number of other reasons, lens manufacturers use a computer read out, the modulation transfer function (MTF), to better express lens performance.  Rather than giving resolution figures, the MTF is based on a fixed resolution value, giving the contrast level of the lens over the entire image area at the various f/stops.

MTF functions also rely on a test target.  Like in the example above, the target shows vertical and horizontal lines.  This is done because most lenses can distinguish fine detail better in one direction than the opposite.  This is the reason why MTF functions always show two curves, one for the sagittal test patterns and another for the tangential or meridional one.  Either one shows the lens performance starting at the center of the image and going out to the edge of the image.


50 APO M MTF
This is the MTF function of the Leica 50mm f/2 Apo-Summicron-M at f/2, f/2.8 and f/5.6
The four curve pairs show the level of contrast at 10, 20, 40 and 80 lines per millimeter resolution.
The curve at f/5.6 is an optics designer's dream, virtually flat across the top of the chart,
a performance level unrivaled by other manufacturers.

MTF chart for the AF-S DX NIKKOR 35mm f/1.8G lens 
A competitor's MTF function for a similar lens.
Please note: The function is only for 10 and 30 Lines/mm with no indication of the aperture,
and it only gives information up to about 15mm from the center.
The Leica MTF function above gives the information up to 21mm from the center

Most published MTF curves are based on a rather low resolution of 10 and 30 lines per millimeter at the most.  The same “standard” is used by most magazines and digitally published tests for their resolution figures.  It is obvious that 30 l/mm is a criterion that can be met by virtually any lens short of the bottom of a pop bottle.  So it is no wonder that the majority of the lenses tested do achieve relatively good figures; especially in view of the fact that a 100% contrast rendering is unattainable.  But even with these relatively low criteria, the much more even performance level of the Leica lenses is still revealed.  Even at maximum aperture they usually perform to levels that many other lenses do not achieve unless stopped down, if at all.   If the contrast figures were based on a resolution of 60 l/mm or even higher, it might become apparent that there are substantially greater differences among various brands of lenses than we are usually led to believe.  It must also be noted that competitors MTF functions rarely show figures all the way to the edges of the image frames. In the examples above, Leica shows results up to 21mm from the center while the competitor’s chart goes to about 15mm from the center.

I have often maintained that photographic magazines and websites which get the majority of their revenue from advertising, have to conduct themselves in a manner that is not detrimental to their advertisers.  Although these tests are generally very good and unbiased, they are also conducted and presented via criteria which work to the advantage of the publication's subsidizers.

I think it is (or should be) obvious that optical companies other than Leica are all very much capable of making first rate equipment.  But their merchandise is also in most cases heavily mass produced.  The bench-made process, as used by Leica, gives them a good competitive edge.  But the superiority of Leica lenses especially shows itself in extreme situations.  This includes lens performance at maximum apertures and performance under adverse conditions.  Unfortunately, published tests do not always consider this and subsequently Leica lenses often seem to be less of an advantage than generally expected.

One might also notice in the written evaluations of Leica lenses that the writers often seem to be a bit strained to avoid the overuse of superlatives.  But we have seen comments like “...the lens against which all others have to be measured (400mm Telyt)...one of the best lenses ever tested (50mm Summicron)...the closest to our test standards ever (40mm Focotar).”

 
Grinding of an aspherical lens element at Leica

Checking the surface accuracy of a lens element at Leica

In recent years aspherical lens elements have been used more and more in obtain better optical correction of lenses.  Leica has come a long way since they introduced the first commercially produced lens with aspherical elements back in 1966.  That was the original Noctiluc 50mm f/1.2.  Aspherical elements could only be manufactured with careful hand grinding and/or hand finishing, a very expensive preposition.

Today lens manufacturers use three different approaches.  The least expensive one is to make a standard lens element with spherical surfaces and then apply a thin, asperical plastic layer on top of it, usually made of a high quality acrylic.  This method was first developed by Zeiss.  They ultimately discarded this process because it could not match their high quality standards.  The problem was, and still is, that even the best acrylics contain rather huge molecules.  Light, when transmitting through such materials, will literally scatter and thus adversely influence lens performance.  The result is that only relatively inexpensive lenses are made with this process.

A noticeably better performance can be achieved by precision molding glass elements.  Here the prefinished glass elements are reheated to the point where they become pliable and are then precision molded into their final shape.  However not all photographic glasses lend itself to this process.  Especially glasses with a high refractive index and a low level of dispersion cannot be used for this process.  Subsequently such glasses, which are generally used to increase optical performance, must be replaced with glasses of less desirable properties.

 

All Leica lens elements are individually ground by precision grinding machines

The best and unfortunately most expensive method to make aspherical lens element is to grind them into their required shape.  Leitz has developed this process to a level unavailable to other manufacturers.  They apply tolerances of 0.0001mm or 0.1 μm (micrometer), a level of accuracy not available from other consumer lens manufacturers.  The result is that Leica today is the foremost manufacturer of high end aspherical lens elements.  The complexity of this process is shown by the fact that Leica tried to have some other lens manufacturers make some aspherical lens elements for them to increase production.  The process requires such high precision that Leica often can only produce as few as 10 or less such elements in one day.  This did not work out because the lens manufacturers they contacted either were unable to make the lens elements with the required precision or they were unable to make them within the cost parameters required by Leica.

 
The grinding compounds for many lens elements is of an exotic nature that requires constant agitation to avoid deterioration 

So far we have talked much about optical performance, the sole criterion used in most lens tests.  The mechanical quality of a lens, however, is just as important.  Poor mechanical design and quality will eventually degrade even the best lens to mediocre performance.  Automobile magazines routinely run 50,000 or even 100,000 mile performance tests on automobiles and I have often hoped that something like this would be done with cameras and lenses as well.  The performance of a lens, when brand new, is one thing, especially if it is delivered for tests by the manufacturer after careful tweaking and adjusting to assure the best possible performance.  But what about its capabilities after it has gone through several months of use, after it has been knocked around in gadget bags, in cars and airplanes for an extended period of time?  Heavy use and the rigors of professional use take a great toll and only the best will remain on top.  This is where mechanical quality translates into optical performance and shortcuts in quality will show lower grade results immediately.

Price is the final criterion I should mention.  Nobody in the optical industry today is able to perform any miracles.  Although mass production does have a beneficial influence on the price of lenses and cameras, this advantage quickly fades when we deal with lenses of an exotic nature that are sold in a much smaller quantity and cannot be mass produced.  Suddenly we find lenses from competing companies to be equally expensive than their Leica counterparts.  Extreme wide angle lenses and long telephoto lenses, especially those that have proven to be close in performance to their Leica counterparts, usually sell for not much less than their equivalent of Leica lenses.  This is the case with most of the major lens manufacturers.  Yet when dealing with absolutes in performance, none of them have anything to offer that can compete on all levels with the newly designed Leica lenses featuring apochromatic design and aspherical lens elements.  The heart of any camera system is its line of lenses, and this is still one of the main reasons for choosing a Leica.



For other articles on this blog please click on Blog Archive in the column to the right

To comment or to read comments please scroll past the ads below.

All ads present items of interest to Leica owners.


_________________________________________________________________________


      www.eddycam.com        

      



Buy vintage Leica cameras from 
America's premier Leica specialist 

                          
           http://www.tamarkinauctions.com/               http://www.tamarkin.com/leicagallery/upcoming-show




Click on image to enlarge

Please make payment via PayPal to GMP Photography

Click on image to enlarge
Please make payment via PayPal to GMP Photography

Click on image to enlarge
Please make payment via PayPal to GMP Photography




AN INTERVIEW WITH MAX BEREK

The credit for the invention of the Leica is always given to Oskar Barnack, and rightfully so.  But it is doubtful that the camera would have been successful, had it not been for the incredibly well performing lens designed by Dr. Max Berek.  Thus he deserves equal credit for the success of the early Leica cameras and lenses, which is exactly the reason why this blog gives credit not only to the Leica and Oskar Barnack but to Max Berek as well.

The following interview is historic in nature.  I translated it from LEICA BREVIER, published in Wetzlar in 1949.

I have not been able to learn who the interviewer was, but Max Berek's answers are always interesting and often intriguing in light of technical developments of the intervening decades.

 
Max Berek

Q:  Herr Professor, you designed the first Leitz lens. The Elmar 50/3.5 and later the Summitar 50/2.0.  Both are referred to as “universal lenses.”  Does that mean the Elmar has been surpassed by the Summitar?

MAX BEREK:  I am glad you asked this question first.  Even beginners in photography believe they can't get by anymore with a lens opening of less than f/2, to be prepared for all occasions.

But I want to get more detailed.  When Leitz, after almost ten years of development, introduced the Leica in spring of 1924 (ed. Note: 1925), it didn't start with a lot of advertising, like most inventions, but it was humbling and exploring; it was to speak for itself when it came to prove its right for existence.  It was perfectly clear to us that something so principally new and tradition-defying as this camera would only be accepted with the greatest reservations by most photographers; the manufacturer, though known worldwide in scientific circles for its microscopes, was totally unknown as a camera maker.  Therefore we had to try to prevent the possibility of being discredited right at the beginning.  And that meant especially the creation of a high quality lens.

Of course, we would have been in the position at the time to design a lens with an aperture of f/2, but the amateur possessed as much as no experience for the useful application of such a fast lens; they didn't know the pitfalls and the difficulties.  So we gave the Leica, for well-considered reasons, a normal lens with a speed of f/3.5.  For the time this was already unusually fast and still today it does justice to all tasks the amateur might ask of it for his pictures.  Even he who has only little experience will agree with this and should know especially that the times when it is absolutely necessary to have a speed of f/2 are rare for the amateur.

If, however, as an experienced Leica photographer one often takes pictures under very unfavorable lighting conditions, like sports and vaudeville photographs, of course he wouldn't want to be without a fast lens.

One knows from his own experience the limits of large apertures, if for no other reason than the rather shallow depth of field and you shouldn't have the ambition to photograph everything under all circumstances wide open, just to save on exposure time.  One also knows that most pictures by far are made at apertures of f/5.6 or f/8 and that therefore an aperture of f/3.5 presents a fine reserve for adverse lighting conditions.  But even at full aperture the Elamr still has such a great depth of field that with halfway correct focusing one will always obtain good pictures and that is exactly what we wanted to achieve in the first years of Leica photography.  Not until later did we change over to increasing apertures to f/2.5 and f/2 and lately f/1.5.  This is still the path everybody should take and nothing would be more wrong than to start with wide apertures.

 
Max Berek's notes for the design of the 50mm f/3.5 Elmax,
the original lens of the Leica Model A or Leica 1

But the Elmar has another advantage: it is very robust, space saving and lightweight.  Just think of a mountain climber – I don't mean the one going on walks in the mountains, but the real climber taking pictures in dangerous situations – he can't risk fighting the difficulties that the use of a fast lens will bring with it.  For him the Elmar is invincible  In my Alpine photography at the Matterhorn, at the Monte Rosa, etc. - these must be the first ones taken with a Leica – I only used the Elmar f/3.5 and still today these pictures will withstand any critique.  The Elmar 50/3.5 will always be the recommended lens for the amateur.

Q:  Yes, and how is it with color pictures?  How do lenses behave there?

MAX BEREK:  Well, as you know, color film is pretty much equally sensitive to all types of light of the visible spectrum.  The condition, of course, is that the lens in use has favorable color correction over the entire visible spectrum.  The old anastigmats, 30 to 50 years ago for instance, wouldn't be of much use because they were corrected for film materials that were mainly sensitive to green, blue and even purple.  The correction in the red end of the spectrum was totally neglected at the time.  The first Leica lens, however, already possessed a color correction over the entire visible spectrum.

One could say that the lens that fulfills the needs of panchromatic film will do so with color film.  It is like this: black and white film will always show its density as a shade of black, whether or not it is caused by red, yellow or blue light.  If the light will cause unsharpness, this will be registered by the film, regardless which light might have caused it.

 
Max Berek at his desk

With color film this is different.  Then the red and the blue part of the spectrum will only be registered  in proportion to the sensitivity of the eyes which are most sensitive to yellow.  Therefore the spherical correction of a lens has to be especially good for the center part of the spectrum and that is something that was taken care of in Leica lenses in the very first examples.

In practical applications another point is even more important: the freedom from vignetting in a lens.  Normally vignetting shouldn't influence the color correction since the combination of the light does not change.  In practice, however, it will affect it anyway since color film has a comparatively narrow exposure latitude.  If the lens shows rather strong vignetting, the corners of the picture will slip very soon into the region of underexposure and will show wrong color values.  Therefore the fast Leica lenses also have rather large front elements.

Q:  That is especially noticeable with the Summitar.  But doesn't the general speed of the lens become higher due to the larger front element?

MAX BEREK:  No, only the evenness of illumination is improved.  The important thing is the pupil diameter of the diaphragm in its apparent size as seen from the front of the lens through the front elements.  With modern, fast lenses this is usually smaller than the free diameter of the front element for the following reasons: take a lens in your hand, hold it in front of a piece of white paper and look straight down into the lens.  You will see a white circle of light.  That is the opening that is influencing the center of the image area.  Now tilt the lens a little bit.  You will notice immediately that the speed of the lens has to become less toward the margins of the picture.  To avoid this vignetting as much as possible, it is necessary to make the front element larger than the relative opening at the center of the lens would necessitate.

Q:  Herr Professor, I heard that Leitz has already designed lenses with an opening of f/0.85.  Why are these lenses not generally available?

MAX BEREK:  That was a special edition for X-ray photography.  For general photography such speeds of course aren't of value.  The depth of field alone is so narrow with such openings that three dimensional objects could not be shot.  And even with X-ray photography it became apparent that the lens should be stopped down to at least f/1.2 to obtain a greater resolution.

Q:  I recently read about a “rubber lens” (ed. Note: from the German Gummilinse, a common expression for zoom lens) which enables you to dial in various focal length at will.  Why don't you make something like this instead of manufacturing eight different lenses in focal lengths from 28mm to 400mm, which I can't afford altogether and for which I would have to lug around a whole suitcase?

MAX BEREK:  You would need a suitcase made especially for your zoom lens and I think every Leica amateur would object to lugging around such a monster.

The lens would really be very large, unhandy and heavy since it would have to consist of more than 20 elements and we shouldn't even talk about the cost; it would be higher than the combined cost of all the Leitz specialty lenses it had replaced.  For large, professional cine cameras such a lens might have its place, but the Leica will do better to stay with its interchangeable lenses.  Besides, you will never need all the Leica lenses at the same time.  Rather, you will usually get by with three, a normal, a wide angle and a long lens like the 90mm Elmar.  Even an amateur can afford such an outfit if he buys it little by little.

And the term “rubber lens” is not exactly appropriate; it is rather a lens with continuously adjustable focal length.

Q:  To what degree are there fault free lenses?

MAX BEREK:  Scientifically, there is only one faultless optical system as Göttingen mathematician Felix Klein demonstrated, a combination of plane mirrors.  Such a system creates unrecordable images.

We do not have the ability to create images totally without faults.  In this sense there are no perfect lenses.  The problem is to correct the mistakes so that, in view of the practical application of the lens, it can be considered perfect.

Q:  What certainly does the buyer have of obtaining a perfect lens?  Is one as good as the next?

MAX BEREK:  Everything depends on tolerances; they must be so close that the remaining errors will have no influence.  That is assured by a production system thought out to the smallest detail, one that covers the entire creation of a lens.  It starts right at the cutting of raw pieces of glass by controlling impurities, stress lines, etc.  This control increases during the manufacture of each single element, while shaping it by grinding, while polishing and mounting it and combining it with the rest of the optical system.  When the lens to be finally passes all tests prescribed during the individual working steps, it still won't be delivered, but will be tried for critical test exposures.  Thus the buyer in each case will have the assurance of getting a perfect lens.

 
Max Berek's house in Wertzlar

But I want to mention something else which now and then has led to questions.  All Leica lenses are manufactured of high quality glass types which have to be specially melted.  With some of these glasses, for which very characteristic optical properties are prescribed, it is impossible to totally eliminate little air bubbles within the glass.  In the first days of the Anastigmats such bubbles were even seen as a mark of a good lens.  To some degree this is also true today.  These bubbles do not have any influence on correction and can be accepted without reservation.

Q:  Can you tell us what innovations we amateurs might expect in reference to Leica lenses?

MAX BEREK:  Substantial innovation cannot be expected in the near future.  It is little known though that besides the 50/1.5 Summarit we also offer an 85/1.5, the Summarex.  The long focal length makes it especially suited for portraits, photojournalism, stage and vaudeville photography and similar purposes.  You might also be interested to know that the line of Telyt lenses with focal lengths of 200mm and 400mm has been widened with an additional lens in the extreme focal length of 800mm.  Of course, this lens is only of interest to the professional.

Now I would like to say something to finalize.  With the state of the art of our optics, a well done picture is not so much an optical problem as it is a problem of the technical precision of the camera, the properties of the taking material and especially the training of the user.  The feeling for a good picture can best be developed by enlarging or projecting one's pictures large scale.  Only then will the amateur have the full enjoyment of his work. 

-------------------------------------------------------------------------------------------------------------------

Please Note: The photographs in this article are from the Book “Max Berek , Schöpfer der ersten Leica Objektive, Pionier der Mikroskopie” (Max Berek, creator of the first Leica lenses, pioneer of microscopy), used with permission.

Lindemanns Verlag
Nadlerstrasse 4
70173 Stuttgart


ISBN 978-3-89506-284-1


For other articles on this blog please click on Blog Archive in the column to the right

To comment or to read comments please scroll past the ads below.

All ads present items of interest to Leica owners.


_________________________________________________________________________


      www.eddycam.com        

      



Buy vintage Leica cameras from 
America's premier Leica specialist 

                          
           http://www.tamarkinauctions.com/               http://www.tamarkin.com/leicagallery/upcoming-show




Click on image to enlarge

Please make payment via PayPal to GMP Photography

Click on image to enlarge
Please make payment via PayPal to GMP Photography

Click on image to enlarge
Please make payment via PayPal to GMP Photography