Our test criteria
Complementary to our reviews, you will find explanations to the tests and evaluations we have executed, as well as an interpretation aid for the evaluation results.
You can find general information on the topic of buying a notebook in our notebook Purchase Consultation.
In our Notebook Hardware Guide you will find an aid for type matching and the technical configurations of a notebook.
Quick links:
> Introduction > Case > Connectivity > Input devices > Display > Performance > Emissions > Battery Life
Introduction
In order to give you a general picture of a notebook, we have created a criteria catalogue based on the long-year experience of our editors with uncountable notebook brands and models, which ought to cover every aspect significant to purchasing a notebook. Naturally, you live and learn and also laptops or rather their specifications change. For this reason, we try to develop and improve our test reports continuously. Our readers, who give us food for thought by means of their lively support but also critique in our forum, provide important contributions and consequently they have the possibility to influence the development of the online magazine NotebookCHECK.net.
Therefore, we would be pleased to welcome you to participate to this exchange of thoughts. You can state your opinion either via e-mail or even in the forum of our German site (NotebookChECK.com). All review editors, as well as a whole row of engaged moderators are available here.
Aside from the decision, which technical configuration, such as processor, graphic card, RAM, hard disk, etc. your notebook should have (more in our Notebook Hardware Guide), there are still a lot of important open aspects to consider before buying a notebook. Extensive decision guidance can be found in our notebook Purchase Consultation.
In the following you will find an overview of all review test points from NotebookCHECK.net and also a detailed explanation.
Case
The cases of our test devices are examined carefully for flaws in workmanship such as: uneven gaps, blemishes in the finish and material weaknesses like unstable components.
The notebook construction is also tested in view of robustness and winding stiffness. The chassis is exposed to burdens as they can also turn up at daily use with the device. These include burdening the case with point or face pressure as they might happen when picking up the notebook at its front edge.
Of course, the performance of the display lid plays an important role in the process because it encloses the sensitive screen and therefore also has a protection function.The modality of the hinges, as well as the closure mechanism (if applicable), are examined on its functionality and manner in practical use.
The workmanship rating lies in the judgment of the single editor and is made after consulting the editorial team for comparison to previous test devices.
Connectivity
On top of that, the offer of available connections is rated and their position on the device is tested on practibility. This is done under consideration of the device class because the expectations put into a less mobile DTR notebook are naturally completely different than those put into an, for instance, ultra mobile subnotebook.
Ergonomical aspects in view of the connection distribution also play an important role. Questions such as: does the occupation of a large amount of the available ports obstruct the usability of the notebook, or: do the various ports influence each other or rather the position of the "permanently occupied ports" such as power supply and LAN port are substantial criteria.
In regards to connectivity, the offered communication features like LAN, WLAN, Bluetooth, UMTS and the alike are handled and if necessary tested.
The supply of diverse safety features, and in case of existing equipment and shipment, are also tested and assessed here, as well.
Input Devices
The quality of the input devices, such as keyboard, Touchpad, also if present, trackpoint and the diverse hot keys, as well, has an important function in notebooks. Important criteria in the test are, for example, the keyboard layout, id est the arrangement and placement of the single keys, possible grouping of the function keys and the split-up of the available space for the keyboard. In the frame of our tests of the input devices, the workmanship, accordingly the fitting of the keyboard unit into the base unit, is also checked.
The key size shouldn't be ignored, either. Keys which have been greatly reduced make it hard to use the device and need a cumbersome accommodation period. This applies especially to subnotebooks, where the case size is defined through the display and therefore partly cuts the keyboard extremely.
A further important, though subjective, point is the responsiveness of the keys and the Touchpad, the typing feel and the soundscape emitted while typing. Our aim is to formulate the description of this as objectively as possible, so that the reader can build their own opinion.
The keyboard as well as the Touchpad and other applied input devices are tested on their user-friendliness and practicability in everyday use. This rating is also made by the responsible editor under comparison of previous tests of comparable device categories.
Display
An important attribute of the display is the display format or rather the maximum educible resolution. At present especially widescreen displays with a 16:10 format and a resolution of 1280x800 pixels (WXGA) up to a maximum of 1920x1200 pixels (WUXGA) are common.
You can find more information about display size, resolution and the "grain size" of displays in this FAQ editorial.
The test of the built in display screen in the test sample involves several criteria, for instance, display brightness and luminance of the display. This is measured with the support of a colorimeter or rather a special monitoring device from the company Gossen (Mavo Monitor). The display is divided into nine equal measuring zones for this cause, in which respectively the centrally brightest during mains power supply is recorded. These measuring results are indicated in cd/m2 (candela pro square meter).
The display brightness should have a minimum of about 100 cd/m2 for work in averagely lighted interiors. A lower brightness as well as a higher brightness can stress the eyes at longer use of the display. An especially high brightness is therefore only sensible to an extent and, as a rule, depends on the planned use of the notebook. Displays with a matt surface need about 170 cd/m2, and glossy displays considerably more, in order to achieve a sufficient contrast and image quality for outdoor work in much brighter surrounding light conditions with the notebook.
The brightness distribution or rather the display illumination is among other things an important asset of a high quality display and is indicated by us in percent. This value specifies the brightness percentage at the darkest reading point in comparison to the brightest. A too big difference can cause an irregular illumination, which can even be seen with the naked eye.
The display contrast principally specifies the ratio of how much more white in comparison to black is represented on the display due to the fact that black also has a certain amount of residual brightness. We evaluate the contrast at undimmed, maximum brightness in the central measuring area of the display. The lower the measured black value and the higher the maximum brightness in this range, the higher the contrast ratio.
Acceptable values for notebook lie at about 150:1 up to 300:1 or even higher. The subjective perception of the displayed image also depends on the screen surface, which can turn out as matt or reflective. The advantages of matt screens lie especially in the unreflective surface, which is eye-friendlier when working at the display for longer periods. Glossy displays profit, as a rule, from a slightly fresher color representation and partly better contrast values.
Furthermore, you will find numerous tests under the point graphic display, which show the run of the presented colors by means of a diagram and the presentable color space as a triangle. Deviations from the line at infinity (diagonal) of the single diagrams are to be seen as necessary corrections for these colors.
Because the reaction rate can only be measured with considerable technical complexity, we only refer to the manufacturer's declaration, if possible or make a subjective evaluation on the basis of various gaming tests.
The viewing angle stability plays a more or less big role, depending on the utilization field of the notebook and the user's activities. In which viewing angle a stable image representation can be counted with, is described in the viewing angle stability check. This is supported with pictures, which show the notebook with a test image out of the singly defined angles (frontal, 45° horizontal and vertical, and two free pictures). Sometimes a video is also presented, which follows the viewing angle and possible reflections on the display can be observed.
Performance
Depending on the device category at hand and the possible utilization field, we test the performance of the particular model on the one hand with various benchmark tests (these are programs, which put a demand on the single components or the whole system and rate by means of achieved points) and on the other, with a practical test with different programs and computer games, because these often push the processor and the graphic card to their limits.
Among others, the 3D Mark and PC Mark benchmark tests from Futuremark, Cinebench R10, as well as various games, either in the demo or full version – depending on availability – are used.
You can recognize where the tested notebook is positioned in comparison to other class competitors or in relativity to the established minimum and maximum values based on the various diagrams.
No modifications are made on the test system in regards of the graphic driver, unless this is explicitly noted for demonstration reasons. An improvement of gaming and benchmark performance can often be achieved through an update with the most current graphic card drivers and possible modifications. Nevertheless, our opinion is that it is the responsibility of the manufacturer to configure their system with the utmost current and efficient software because it is irrational to expect an average user to operate with partly uncertified drivers.
The efficiency of the hard disk is established with the benchmark tool HDTune, which notes minimal, average and maximum transfer rates as well as access times and the load of the CPU.
At the moment, generally three different hard disk models are built into notebooks, which differ in their rotation velocity (4200, 5400, 7200 rpm) and successively also have different transfer rates and access times. Sporadically there are also so-called SSD drives (Solid State Drive) to be found, which distinguish themselves through their particularly low access times and silent operation.
Further information:
- Comparison of mobile graphic cards - detailed information, technical Data and performance values of all available graphic cards, sorted by efficiency.
- Comparison of mobile processors - extensive information and data of all mobile CPUs built into notebooks
- Benchmark listing of mobile graphic cards - sortable chart, in which all available mobile graphic cards can be classified by the various benchmarks and technical data.
- Benchmark listing of mobile CPUs - sortable chart, in which all available mobile processors can be classified by the various benchmarks and technical data
Emissions
System Noise
Our evaluations are made with a noise level monitor in compliance with a standardized test arrangement. The monitor is fixed at a certain distance to the notebook and secured against possible vibrations transferred directly. The measurement results are recorded in dB (decibel).
You can orientate yourself on the following comparative values, for the interpretation of the measurement results:
If absolute silence for the human ear is in a room, then a background noise level of about 28 dB is at hand. A discussion at normal volume has approx. 60 dB. Whispering creates a volume of about 40 – 45 dB. All of these values depend very strongly on the distance to the sound source. Our measurements are therefore made at a fixed distance to the test sample, in order to receive a significant result. These measurements are represented graphically and can be estimated on a subjective feeling scale:
- Under 30 dB: Operating noise is barely perceptible.
- Up to 35 dB: Noise is audible but not disturbing. Ideal state for work devices in office use.
- Up to 40 dB: Noise emissions are very audible, possibly disturbing after a longer period.
- Up to 45 dB: Noise emissions are unpleasant in a quiet surrounding. Still acceptable at gaming.
- Above 50 dB: At this level and beyond, a notebook can be described as unpleasantly loud.
Temperature
The surface temperature distribution, which is also directly palpable for the user, is established by a contactless measurement with the help of an infrared thermometer. For this, the notebook is also divided into nine measuring zones, in which the specific maximal established value is recorded.
The measurements follow the run through of all standard benchmarks (3D Mark, PC Mark, Cinebench) to grant comparable results. With the diagram at hand, you can read the surface temperature distribution and interpret this in accordance to the following scale:
- Less than 30°C: Barely perceptible and unnoticeable heating.
- 30 bis 40°C: Heating is very well noticeable but not disturbing.
- 40 bis 50 °C: At direct contact, unpleasant after a longer period.
- Above 50°C: Surface is percieved as being hot, problematic especially at use on the lap.
Loudspeakers
The evaluation of the loudspeakers is made in regards to their sound and the maximum volume. The placement of the speakers is also considered. The evaluation is made subjectively and in reflection of previous test devices. Depending on the device use it should also be considered that there are both devices with minimized speakers (subnotebooks), which are designed more for the use with headphones, as well as notebooks with integrated subwoofers and high quality loudspeakers, which are capable of emitting an remarkable sound.
Battery Life
Substantial for the notebook mobility is in particular the achievable battery runtime in various modes. This evaluation is made in relation to the single device categories (subnotebook, office, multimedia, desktop substitute) in comparison to previous test devices. Currently, we use four different runtime tests:
Minimum runtime: This is ascertained by operating under load with the help of the software tool BatteryEater (Classic Test). Following settings are used on the test device: maximum display brightness, every possible option on (WLAN, Bluetooth…), performance profile maximum efficiency, performance, or the like.
Maximum runtime: Is also determined with the BatteryEater tool (Reader's test). The maximum possible operating time is measured at minimum display brightness, all power saving functions on, WLAN and/or Bluetooth off, performance profile energy savings mode, and minimum energy consumption or similar.
WLAN mode: The reachable runtime at practical, wireless WLAN operating with maximum display brightness and activated power saving possibilities (performance profile: energy savings mode or the like).
DVD playing: The runtime of wireless DVD playing mode at maximum display brightness, deactivated WLAN and Bluetooth and activated power saving measures (performance profile: energy savings mode or higher if required for a smooth rendering).
It is to be considered that the test samples are, as a rule, new devices and the full battery performance can only be reached after a few charge and discharge cycles. The tests also give only a snap-shot of the test system. Further information on how you can optimize the battery life of your device is found in this FAQ editorial.
Beside the battery runtime, the notebook's power consumption in various operating modes is also tested. We differentiate the following operating modes:
Idle mode: Energy consumption in use without load. Minimum: Every optional function deactivated (WLAN, Bluetooth…), minimum display brightness and activated power savings measures (performance profile energy savings mode). Medium: Maximum brightness, optional functions deactivated, Windows performance profile "balanced". Maximum: Maximum observed energy requirement in idle use, all functions activated (WLAN, Bluetooth…), maximum display brightness, performance profile "high performance".
Loud: Operating under load at maximum display brightness, all optional functions activated, Windows performance "high performance". The benchmark program 3D Mark 2005 is drawn on for the test and the maximum or rather the average power consumption under load is recorded.
Every notebook that we test in the frame of an extensive review is rated according to all of the above listed points and in comparison to categorically similar notebooks. The result of the evaluation is composed of a total of 12 points, whereas the achieved points are defined on a scale of 0-100 (the higher the better). In conclusion the tested notebook is rewarded with a total rating, into which the single points flow to a different degree in view of the device category at hand.
You can find more information about our rating system in this editorial.












