HIMSS and RSNA
Integrating the Healthcare Enterprise

 

 IHE/MESA Image Display Tests
Mammography Image Profile

 

Electronic Radiology Laboratory
Mallinckrodt Institute of Radiology
510 South Kingshighway Blvd.
St. Louis, MO  63110
314.362.6965 (Voice)
314.362.6971 (Fax)

 

 

Revision 10.14.0
14-March-2007


Contents:

Mammography - Image Display Tests
Introduction
Configuration.
Starting the MESA Servers
Submission of Results
Test Images

Individual Tests

  1. Test 3917: Image SCU Query Keys
  2. Test 502: SCU Query Evaluation
  3. Test 3995:  Retrieve “For Presentation” Images
  4. Test 500: Display Calibration
  5. Test 4000 (00100n): Current and prior with different pixel sizes scaled to fit largest breast
  6. Test 4002 (004001): Four view phantom ruler set with different matrix sizes – scale-to-fit
  7. Test 4004 (004002): Four view phantom ruler set with different matrix sizes – true size
  8. Test 4040 (007001): Identification Attributes for Display
  9. Test 4045 (007002): Technique Attributes for Display
  10. Test 4050 (009001): Application of VOI LUT Data – Sigmoid Curve encoded in LUT
  11. Test 4051 (009002): Application of VOI LUT Data – Scrambled LUT
  12. Test 4052 (009003): Application of VOI LUT Data – Inverted LUT
  13. Test 4053 (009004): Application of VOI LUT Function with SIGMOID value
  14. Test 4054 (009005): Application of VOI LUT Function with LINEAR value
  15. Test 4060 (011001): Application of Pixel Padding Value
  16. Test 4062 (012001): Four view set with different matrix sizes
  17. Test 4070 (013001): Four view set with CAD applied to ‘For Processing’, spatial relationships preserved    
  18. Test 4071 (013002:) Four view set with CAD applied to ‘For Processing’, images need flipping, spatial relationships preserved
  19. Test 4072 (013003): Four view set with CAD applied to ‘For Processing’, spatial relationships not preserved, marks suppressed
  20. Test 3915:  Partial View Option
  21. Test 3916: Mammo Image Display - Vendor Interoperability

Appendix A

  1. Dataset 00100n Notes
  2. Dataset 004001-2 Notes
  3. Dataset 007001-2 Notes
  4. Dataset 009001 Notes
  5. Dataset 009002 Notes
  6. Dataset 009003 Notes
  7. Dataset 009004 Notes
  8. Dataset 009005 Notes
  9. Dataset 011001 Notes
  10. Dataset 012001 Notes
  11. Dataset 013001 Notes
  12. Dataset 013002 Notes
  13. Dataset 013003 Notes

Mammography - Image Display Tests

Introduction

This document describes tests for two grayscale monitor mammography workstations which are Image Display actors in the Mammography Image Profile. The Display Consistency tests are defined in a separate document: Display Consistency Test Plan for Image Displays.

MIR gratefully acknowledges the contribution of David Clunie to this test plan.
These tests and the accomanying dataset were created by David and used
at the North American Connectathon in January 2006. They have
merely been reformatted in MESA test plan style in this document.

Not all of these tests will be required for MESA testing; however, vendors
are encouraged to exercise their system by running of as many as possible.

Consult the Kudu webtool for the list of required tests for your Image Display actor
to be submitted for MESA test results. The remaining tests are candidates
for Connectathon 2007 testing.

Configuration

The MESA Image Manager maintains a database of DICOM applications used for C-MOVE operations.  Add an entry for the storage SCP(s) associated with your workstation.  Edit the text file $MESA_TARGET/db/loaddicomapp.pgsql (Unix) or $MESA_TARGET/db/loaddicomapp.sql (Windows).  Use the existing entries as a template and add entries for your workstation as appropriate.  The column names found in the SQL insert statements are described in the following table.

Column Name

Description

aet

DICOM Application Entity Title.  Must be unique.

host

Host name (or IP address) of the application.

port

TCP/IP port number for receiving associations.

org

The organization that operates the device.  Useful if multiple organizations use the Image Manager.

com

A comment field.

You can test your work as follows:

     perl  load_apps.pl imgmgr 

The file $MESA_TARGET/runtime/imgmgr/ds_dcm.cfg is used to configure the MESA Image Manager.  The only parameter users should change is the LOG_LEVEL value.  Log levels are defined in the next section.  DICOM configuration parameters are listed in the table below.

Application

AE Title

Port

MESA Image Manager

MESA_IMG_MGR

2350

Read the Runtime Notes section of the Installation Guide to determine the proper settings for the MESA runtime environment.

Starting the MESA Servers

These instructions assume you are using a terminal emulator on Unix systems or an MS DOS command window under Windows.  Each test uses a command line interface; there is no graphical user interface.  Before you start the test procedure, you need to start the MESA Image Manager servers.  Make sure the appropriate database is running (PostgreSQL, SQL Server).  To start the MESA servers:

  1. Enter the Image Display exam folder: mesa_tests/rad/actors/imgdisp
  2. Execute the appropriate script to start the servers:
     scripts/start_mesa_servers.csh  (Unix)
     scripts\start_mesa_servers.bat  (Windows)
Log levels are set for the MESA Image Manager in the file: $MESA_TARGET/runtime/imgmgr/ds_dcm.cfg.  Log levels are:

  1. no logging
  2. errors
  3. warnings
  4. verbose
  5. conversational (really verbose)

When you are finished running one or more tests, you can stop the servers:

     scripts/stop_mesa_servers.csh  (Unix)
     scripts\stop_mesa_servers.bat  (Windows)
Log files are stored in $MESA_TARGET/logs.

Submission of Results

Test descriptions below inform the reader to “submit results to the Project Manager”. This is does not mean “email”. The current submission process should be documented by the Project Manager, but will not include emailing files directly to the Project Manager.

Test Images

Images for these tests are distributed along with the MESA Tools and are available at http://ihedoc.wustl.edu. After they are installed, the images referenced in the tests will be found on your sytem under $MESA_STORAGE/MAMMO/IHETESTS/IMAGES.

Individual Tests

Test 3917: Image SCU Query Keys

In this test, the Image Display is required to query the MESA Image Manager using specific matching keys.  For each matching key and value in the table below, direct the Image Display to make one or more queries of the MESA Image Manager.  Repeat or multiple queries are allowed.  That is, you might choose to query several times with a certain matching key.  We do not expect the Image Display to send individual queries with multiple matching keys (Patient Name and Patient ID), but the test software will allow that.

Attribute Name

Tag

Matching Key Value

Study Date

0008 0020

19950126

Accession Number

0008 0050

2001B20

Patient Name

0010 0010

Winston^W

Patient ID

0010 0020

3916

Modalities in Study

0008 0061

DX

References

Instructions

  1. Create/modify the SQL script to identify the Image Display under test.
  2. Start the MESA servers as described in Starting the MESA Servers above.
  3. Load the data sets into the MESA Image Manager.
  4. perl 3917/load_img_mgr.pl
  5. Send at least one DICOM Study Level C-Find request (Study Root model) to the MESA Image Manager for each attribute/matching key value defined in the table above.

Evaluation

  1. Run the evaluation script to verify that each attribute was requested in a query.
     perl 3917/eval_3917.pl <AE Title of Image Display>

Supplemental Information

Results will be found in the file 3917/grade_3917.txt.  If you need to clear the existing queries to run the test again, you can restart at step 3 or run this script

     perl  scripts/clear_img_mgr_queries.pl

Test 502: SCU Query Evaluation

Note: this test depends on test 3917.

This test uses the queries sent by the Image Display during Test 3917 and any other queries you want to evaluate.  This test examines all queries sent by the Image Display to determine if they are legal DICOM queries.
After you conclude Test 3917, the MESA Image Manager will still have a record of the queries sent by your Image Display.  If you want to send more queries to the Image Manager, you may do so.  There are no required queries.  You might want to send queries at the Series and SOP Instance level.

References

Instructions

Evaluation

Evaluate the Image Display queries as follows:

     perl  502/eval_502.pl <AE Title of Image Display>

Supplemental Information

Query results are stored in the file 502/grade_502.txt.
As above, you can clear the queries stored by the MESA Image Manager as follows:

     perl scripts/clear_img_mgr_queries.pl

 

Test 4000 (00100n): Current and prior with different pixel sizes scaled to fit largest breast

This test confirms that, based on the attributes:

  • appropriate images can be chosen regardless of their grouping in single or separate series
  • images with different pixel sizes are displayed at the same physical size
  • appropriate zoom factors relative to encoded and true pixel size is annotated on each displayed image
  • pairs of images are appropriately justified to the chest wall
  • images are horizontally flipped into the correct orientation, since not all of the test images in the test set are already correctly oriented

References

RAD TF-2:4.16.4.2.2.1.1

Setup

Test studies (001001 through 001006) previously transferred to the Image Display under test on DICOM CD or DVD or via DICOM network transfer:

  • Patient ID =001nnn and Study ID=001nnnPRIOR and 001nnnCUR, each consisting of four standard screening views (R and L CC and MLO) only, whose pixel data is already correctly oriented (folder name is 001nnn, file names are CURLCC, CURLMLO, CURRCC, CURRMLO, PRILCC, PRILMLO, PRIRCC, PRIRMLO)
  • Additional notes on the datasets for this test are included in Appendix A.

Instructions

  1. For the following studies, select the current and prior studies for the test subject specified and load them for display:

          - 001001
          - 001002
          - 001003
          - 001004
          - 001005
          - 001006
  2. For each current/prior study display, perform a screen capture and store the result in a JPEG, GIF or other format that is easily displayable using IE.  Name your file using the convention YourCompanyName-4000-n.xxx (where n matches the number of the image set displayed and xxx is the file extension, eg company-4000-001001.jpg).
  3. Tar or zip these files.
  4. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

    Note that 6 screen captures will be submitted for this test!

Evaluation

Screen captures will be evaluated for the following characteristics:

 

- all 8 views are displayed at the same physical size

- the axilla is at the top of each view port

- current CC views are each displayed back-to-back and justified to the chest wall

- current MLO views are each displayed back-to-back and justified to the chest wall

- prior CC views are each displayed back-to-back and justified to the chest wall

- prior MLO views are each displayed back-to-back and justified to the chest wall

- an appropriate factor of displayed pixel size relative to encoded pixel size is displayed with each image

- an appropriate factor of displayed pixel size relative to true size is displayed with each image


Supplemental Information

The following figure illustrates the type of layout anticipated for studies 00100n, with the priors on top, the current study below, the MLOs on the left, the CCs on the right, and the right breast on the left of the left breast:

1

Test 4002 (004001): Four view phantom ruler set with different matrix sizes – scale-to-fit

This test confirms that, based on the attributes:

References

RAD TF-2:4.16.4.2.2.1.1.3.1

Setup

Test study 004001 previously transferred to the Image Display under test on DICOM CD or DVD or via DICOM network transfer:

Instructions

  1. Select study 004001 and load the images for display in scale-to-fit-breast mode.
  2. Using the electronic distance caliper tool in your workstation, measure the size of the horizontal and vertical 100 mm rulers for each of the four images.   Record the measurements using the following format below and save them in a file YourCompanyName-4002-measure.xxx (eg company-4002-measure.txt) and submit the file to the Project Manager for evaluation.

          RMLO:            V ____ mm H ____ mm
          LMLO:            V ____ mm H ____ mm
          RCC:               V ____ mm H ____ mm
          LCC:                V ____ mm H ____ mm
  3. Perform a screen capture and store the result in a JPEG, GIF or other format that is easily displayable using IE.  Name your file using the convention YourCompanyName-4002.xxx (eg company-4002.jpg).
  4. Tar or zip these files.
  5. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

For measurements:

The screen capture will be evaluated for the following characteristics:

Supplemental Information

The following figure illustrates the type of layout anticipated for test 4002 in scale-to-fit mode, with all of the views scaled to (approximately) the same physical size; not the different zoom factors, yet the same displayed pixel size:

2

Test 4004 (004002): Four view phantom ruler set with different matrix sizes – true size

This test confirms that, based on the attributes:

  • images can be displayed at true size (such that the physical size on the display matches the real world physical size)
  • distance measurements can be made that accurately reflect the real world physical size

References

RAD TF-2:4.16.4.2.2.1.1.3.2

Setup

This test uses the same images as test 4002.  These should already be loaded on your workstation.

Instructions

  1. Select the images in 004001 to be displayed in “true size” mode, either as all four views displayed together, or as one view at a time, depending on the capability of the your Image Display
  2. Using a physical ruler, measure the size of the horizontal and vertical 100 mm rulers for each of the four images. Record the measurements using the following format below and save them in a file your-company-name-4004-measure.xxx (eg company-4004-measure.txt) and submit the file to the Project Manager for evaluation.

          RMLO:           V ____ mm H ____ mm
          LMLO:           V ____ mm H ____ mm
          RCC:              V ____ mm H ____ mm
          LCC:             V ____ mm H ____ mm
  3. Perform a screen capture and store the result in a JPEG, GIF or other format that is easily displayable using IE.  Name your file using the convention YourCompanyName-4004.xxx (eg company-4004.jpg).
  4. Tar or zip these files.
  5. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

For measurements:

  • Vertical and horizontal measurements within the same image are within 5% of each other.
  • Measurements of the same ruler displayed in different images are within 10% of each other.
  • Measurements are all within the range of 90 mm to 110 mm (20%).

The screen capture will be evaluated for the following characteristics:

  • Appropriate zoom factors are displayed with each image, and the factors relative to encoded pixel size are not all the same value, and the factor relative to true the size is the same.

Supplemental Information

Test 4040 (007001): Identification Attributes for Display

This test confirms display of required Clinical and Investigative annotation.  It also confirms that Technical annotations (displayed in 007002) can be ‘turned off’.

References

RAD TF-2:4.16.4.2.2.1.1.5.1

Setup

Test study 007001 previously transferred to the Image Display under test on DICOM CD or DVD or via DICOM network transfer:

Instructions

  1. Select image for study 007001 and load it for display.  Ensure ‘Technical Annotations’ are turned off (they are tested in the next test).
  2. Perform a screen capture and store the result in a JPEG, GIF or other format that is easily displayable using IE.  Name your file using the convention YourCompanyName-4040.xxx (eg company-4040.jpg).
  3. Tar or zip these files.
  4. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. All Clinical and Investigative annotations are displayed on the side of the view port opposite the chest wall.
  2. The zoom factor is displayed.
  3. The following DICOM attributes are displayed with the values shown:

Acquisition Date 

20051224

Acquisition Time

173600

Patient’s Age

106Y

Patient’s Birth Date

19010101

Manufacturer

LORAD

Institution Name

St. Elsewhere

Institution Address

1 Smith St, Smallville

Operator Name

Smith^Jane

Manufacturer’s Model Name

Hologic Selenia

Patient Name

IHEMammoTest^Annotations spot mag

Patient ID

007001

Device Serial Number

DEV000

Detector ID

MP1406

Date of Last Detector Calibration

20051207

Image Laterality

R View Code Sequence and Modifier = latero-medial with spot compression and magnification and is shown with the correct abbreviation RMSLM

Software Versions

AWS:3_1_1_10 (AWS 3_1_1_10)\PXCM:1.2.7.1\ARR:1.4.0.26\IP:4.5.2

Station Name

StationABC

Gantry ID

Note:  This attribute needs to be added to the test image when the tag is known.

Supplemental Information

The following figure illustrates the type of annotation anticipated [note: not all attributes in the above table are included in this screen shot]:

 

3

4

 

5

Test 4045 (007002): Technique Attributes for Display

This test confirms display of required Technique annotation.

References

RAD TF-2:4.16.4.2.2.1.1.5.2

Setup

This test uses the same image as test 4040.  It should already be loaded on your workstation.

Instructions

  1. Select image for study 007001 and load it for display.  Turn on Technique annotations.
  2. Perform a screen capture and store the result in a JPEG, GIF or other format that is easily displayable using IE.  Name your file using the convention YourCompanyName-4045.xxx (eg company-4045.jpg).
  3. Tar or zip these files.
  4. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. All Technique annotations are displayed on the side of the view port opposite the chest wall.
  2. The following DICOM attributes are displayed with the values shown below. Note that some attributes to be displayed are, at times, displayed in different units of measuremen than those encoded in DICOM (e.g. Organ Dose is encoded in dGy but is always displayed in mGy, Compression Force is encoded in Newton (N) but it is usually displayed in kilogram force (kgf), etc.). The the unit of measurements used for the display may be chosen by the vendor.

KVP

25

Exposure Time

2806

Exposure

84

Anode Target Material

MOLYBDENUM

Body Part Thickness

39.0

Compression Force

0.0000020

Relative X-ray Exposure

566

Entrance Dose

9788.0

Organ Dose

19.6

Positioner Primary Angle

90

Filter Material

MOLYBDENUM

Supplemental Information

Test 4050 (009001): Application of VOI LUT Data – Sigmoid Curve encoded in LUT

This test confirms that:

References

RAD TF-2:4.16.4.2.2.1
RAD TF-2:4.16.4.2.2.1.1.4

Setup

Test study 009001 previously transferred to the Image Display under test on DICOM CD or DVD or via DICOM network transfer:

Instructions

  1. Select the R and L MLO views for display and confirm the expected result.
  2. Perform a screen capture and store the result in a JPEG, GIF or other format that is easily displayable using IE.  Name your file using the convention YourCompanyName-4050.xxx (eg company-4050.jpg) and submit the file to the Project Manager for evaluation.
  3. Adjust the grayscale contrast of the R MLO so that it is markedly different than the L MLO.
  4. Perform a screen capture and store the result.  Name your file using the convention YourCompanyName-4050-adjusted.xxx (eg company-4050-adjusted.jpg).
  5. Tar or zip these files.
  6. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. For the first screen capture, the appearance of the R MLO is identical to the appearance of the L MLO in terms of grayscale contrast
  2. For the second screen capture, the contrast on the R MLO should appear different than the L MLO.  Although the following cannot be evaluated until the Connectathon, the grayscale contrast of the R MLO should adjust smoothly and continuously without sudden discontinuities or sudden loss of quality in the very dark or light regions.

Supplemental Information

The following figure illustrates the type of appearance anticipated for the frst screen capture for test 4050, with identical grayscale contrast between the R MLO displayed on the left (the one with the actual LUT) and the L MLO displayed on the right (the one with the burned in contrast:

6

8

Test 4051 (009002): Application of VOI LUT Data – Scrambled LUT

This test confirms that an image that contains a single VOI LUT Sequence item with VOI LUT Data, and no window values, is displayed with the VOI LUT applied.

References

RAD TF-2:4.16.4.2.2.1
RAD TF-2:4.16.4.2.2.1.1.4

Setup

Test study previously transferred to the Image Display under test on DICOM CD or DVD or via DICOM network transfer:

    • Patient ID 009002 Study ID 009002, consisting of R and L MLO views (folder name is 009002, file names are VOILUTSC for the RMLO containing the encoded LUT data and VOILUTBU for the LMLO, which has no LUT but the transformation burned into the pixel data and identity window values)

Instructions

  1. Select the R and L MLO views for display and confirm the expected result.
  2. Perform a screen capture and store the result in a JPEG, GIF or other format that is easily displayable using IE.  Name your file using the convention YourCompanyName-4051.xxx (eg company-4051.jpg).
  3. Tar or zip these files.
  4. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. The appearance of the R MLO is identical to the appearance of the L MLO in terms of grayscale contrast.

Supplemental Information

The following figure illustrates the type of appearance anticipated for test 4051, with identical grayscale contrast between the R MLO displayed on the left (the one with the actual LUT) and the L MLO displayed on the right (the one with the burned in contrast):

7

9

Test 4052 (009003): Application of VOI LUT Data – Inverted LUT

This test confirms that, based on the attributes:

References

RAD TF-2:4.16.4.2.2.1
RAD TF-2:4.16.4.2.2.1.1.4

Setup

Test study previously transferred to the Image Display under test on DICOM CD or DVD or via DICOM network transfer:

Instructions

Evaluation

Supplemental Information

The following figure illustrates the type of appearance anticipated for the first screen capture for test 4052, with identical grayscale contrast between the R MLO displayed on the left (the one with the actual LUT) and the L MLO displayed on the right (the one with the burned in contrast:

Test 4053 (009004): Application of VOI LUT Function with SIGMOID value

This test confirms that, based on the attributes, an image that contains window values and a VOI LUT Function with a value of SIGMOID, is displayed with the sigmoid curve.

References

RAD TF-2:4.16.4.2.2.1
RAD TF-2:4.16.4.2.2.1.1.4

Setup

Test study previously transferred to the Image Display under test on DICOM CD or DVD or via DICOM network transfer:

  • Patient ID 009004 Study ID 009004, consisting a single MLO view (folder name is 009004, file name is LUTSHPSG)

Instructions

  1. Display the image for 009004.
  2. Confirm that the window center value displayed is 2665 and the window width value is 750 (the values from the DICOM header).  If the window values were not as specified, adjust them until they are.
  3. Perform a screen capture and store the result.  Name your file using the convention YourCompanyName-4053.xxx (eg company-4053.jpg).
  4. Tar or zip these files.
  5. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. With the window values as specified, the image is displayed and the word “PASS” is faintly visible in the background air.

Supplemental Information

The following figure illustrates the type of appearance anticipated, with the word PASS (faintly) visible twice:

12

Test 4054 (009005): Application of VOI LUT Function with LINEAR value

This test confirms that, based on the attributes, an image that contains window values and a VOI LUT Function with a value of LINEAR, is displayed with the linear curve.

References

RAD TF-2:4.16.4.2.2.1
RAD TF-2:4.16.4.2.2.1.1.4

Setup

Test study previously transferred to the Image Display under test on DICOM CD or DVD or via DICOM network transfer:

Instructions

  1. Display the image for 009005.
  2. Confirm that the window center value displayed is 2665 and the window width value is 750 (the values from the DICOM header).  If the window values were not as specified, adjust them until they are.
  3. Perform a screen capture and store the result.  Name your file using the convention YourCompanyName-4054.xxx (eg company-4054.jpg).
  4. Tar or zip these files.
  5. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. The image is displayed and no text (particularly not the word “FAIL”) is visible in the background air.

Supplemental Information

The following figure illustrates the type of appearance anticipated, with the no text visible:

13

Test 4060 (011001): Application of Pixel Padding Value

This tests the ability of the Image Display actor to replace values in the pixel data that is outside the breast using the value in the (0028,0120) Pixel Padding Value element.  All pixel values equal to the Pixel Padding Value, such as background air, are always suppressed (displayed as black), regardless of:

    • the actual pixel value,
    • the window values, and
    • whether or not the image is displayed inverted.

References

RAD TF-2:4.16.4.2.2.1.1.1

Setup

Test study previously transferred to the Image Display under test on DICOM CD or DVD or via DICOM network transfer:

  • Patient ID 011001 Study ID 011001, consisting of R and L MLO views (folder name is 011001, file names are PIXPADLO for the RMLO containing a Pixel Padding Value that is not zero and of low value, and PIXPADHI for the LMLO containing a Pixel Padding Value that is not zero and of high value).

Instructions

  1. Select the R and L MLO images for 011001 and load them for display.
  2. Adjust the contrast (window) of the R MLO, with very wide windows and low centers.
  3. Perform a screen capture and store the result.  Name your file using the convention YourCompanyName-4060-LO.xxx (eg company-4060-LO.jpg) and submit the file to the Project Manager for evaluation.
  4. Adjust the contrast (window) of the L MLO, with very wide windows and low centers.
  5. Perform a screen capture and store the result.  Name your file using the convention YourCompanyName-4060-HI.xxx (eg company-4060-HI.jpg) and submit the file to the Project Manager for evaluation.
  1. Reset the R MLO and L MLO window values such that the breast tissue displays normally and then invert the images. Perform a screen capture and store the result. 
  2. Name your file using the convention your-company-name-4060-INVERT.xxx (eg company-4060-INVERT.jpg.
  3. Tar or zip these files.
  4. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. When the contrast is adjusted, the air outside the breast tissue remains uniformly black even though the breast tissue becomes densely white. 
  2. The air outside the breast tissue remains uniformly black when the image is inverted.

Supplemental Information

Test 4062 (012001): Four view set with different matrix sizes

This test confirms that, based on the attributes, images with different matrix sizes but the same pixel sizes are displayed at the same physical size when displayed.

References

RAD TF-2:4.16.4.2.2.1.1.2

Setup

Test study previously transferred to the workstation under test on DICOM CD or DVD or via DICOM network transfer:

Instructions

  1. Select the study for 012001 and load the four images for display.
  2. Perform a screen capture and store the result.  Name your file using the convention YourCompanyName-4062.xxx (eg company-4062.jpg).
  3. Tar or zip these files.
  4. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. All 4 views are displayed at the same physical size.
  2. An appropriate zoom factor is displayed with each image, and each of those zoom factors is the same.

Supplemental Information

The following figure illustrates the type of layout anticipated for test 4062, with all of the views scaled to the same physical size:

14

Test 4070 (013001): Four view set with CAD applied to ‘For Processing’, spatial relationships preserved

This test confirms that, based on the attributes:

  • CAD marks are applied for display
  • CAD marks referenced to missing ‘For Processing’ images are displayed on corresponding ‘For Presentation’ images

References

RAD TF-2:4.16.4.2.2.1.1.8

Setup

Test study previously transferred to the workstation under test on DICOM CD or DVD or via DICOM network transfer:

  • Patient ID 013001 Study ID 013001, consisting of four standard screening views (R and L CC and MLO) as ‘For Presentation’ images with references to the source ‘For Processing images’, and a single Mammo CAD SR object containing references to ‘For Processing’ images (folder name is 013001, file names are LCC, LMLO, RCC, RMLO, CAD).

Instructions

  1. Select the study for 013001, load the four images for display, and activate CAD mark rendering.
  2. Perform a screen capture and store the result.  Name your file using the convention YourCompanyName-4070.xxx (eg company-4070.jpg).
  3. Tar or zip these files.
  4. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. Calcifications and densities are marked on the RMLO view.
  2. Densities are marked on the RCC view.
  3. No marks are present on the LCC and LMLO views.

Supplemental Information

The following figure illustrates the type of appearance anticipated for test 4070, recognizing that the rendering of the CAD marks is for demonstration purposes only, and does not follow the CAD vendor’s recommendation:

15

Test 4071 (013002): Four view set with CAD applied to ‘For Processing’, images need flipping, spatial relationships preserved

This test confirms that, based on the attributes:

References

RAD TF-2:4.16.4.2.2.1.1.8

Setup

Test study previously transferred to the workstation under test on DICOM CD or DVD or via DICOM network transfer:

Instructions

  1. Select the study for 013002, load the four images for display, and activate CAD mark rendering.
  2. Perform a screen capture and store the result.  Name your file using the convention YourCompanyName-4071.xxx (eg company-4071.jpg).
  3. Tar or zip these files.
  4. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. Images are flipped into the correct orientation such that the pairs are back-to-back (chest wall opposed).  If this is correct, verify that:
  2. Calcifications and densities are marked on the LMLO view.
  3. Densities are marked on the LCC view.
  4. No marks are present on the RCC and RMLO views.

Supplemental Information

The following figure illustrates the type of appearance anticipated for test 4071, recognizing that the rendering of the CAD marks is for demonstration purposes only, and does not follow the CAD vendor’s recommendation; note in particular that the left MLO and CC have been flipped correctly prior to application of the CAD marks:

16

Test 4072 (013003): Four view set with CAD applied to ‘For Processing’, spatial relationships not preserved, marks suppressed

This test confirms that, based on the attributes, CAD marks referenced to missing ‘For Processing’ images but for which spatial relationships are not preserved are suppressed from display on corresponding ‘For Presentation’ images.

References

RAD TF-2:4.16.4.2.2.1.1.8

Setup

Test study previously transferred to the workstation under test on DICOM CD or DVD or via DICOM network transfer:

  • Patient ID 013003 Study ID 013003, consisting of four standard screening views (R and L CC and MLO) as ‘For Presentation’ images with references to the source ‘For Processing’ images but with spatial relationships not preserved, and a single Mammo CAD SR object containing references to ‘For Processing’ images (folder name is 013003, file names are LCC, LMLO, RCC, RMLO, CAD).

Instructions

  1. Select the study for 013003, load the four images for display, and activate CAD mark rendering.
  2. Perform a screen capture and store the result.  Name your file using the convention your-company-name-013003.xxx (eg company-013003.jpg).
  3. Tar or zip these files.
  4. If the file is small enough, you may upload it into the Connectathon webtool as results for this test. If the file is too large, send an email to the Project Manager stating that you are ready to submit results. Do not email the zipped objects. You will receive a response containing instructions for submitting your objects to an ftp site or sending in a CD.

Evaluation

  1. No marks are present on any of the views

Supplemental Information

Test 3915:  Partial View Option

Note: This test is not yet implented in the MESA tools for Image Display actors.

This test only applies to Image Display actors which support the Partial View option in the Mammography profile.
The Image Display must annotate the displayed image using the values in:
- (0028,1350) Attribute Partial View
- (0028,1352) Partial View Code Sequence

References

RAD TF 2: 4.16.4.2.2.1.1.7

Instructions

To run this test, follow these steps:

  1. Open or import the image in file MESA3915.dcm. From the imgdisp test directory, you can use the script:
     perl  scripts/send_mammo_image.pl 3915 <AE Title> host port
   
     to push (DICOM C-Store) the image to your Image Display actor.
  1. Display the test image, including annotation indicating that this is a Partial View, and which region of the mosaic the image represents.  Perform a screen capture

Evaluation

A screen capture is created in this test; store the results in a JPEG, GIF or other format that is easily displayable using IE.  Label the files using naming convention of:
          YourCompanyName_YourProduct_3915_ID_2006.doc ,
Submit to the Project Manager for evaluation.

Supplemental Information

Test 3916 : Mammo Image Display - Vendor Interoperability

This tests the display of image and CAD SR objects created by other vendors. Every vendor mammo DICOM object submitted to the MESA tools must be tested and properly displayed. There is no MESA software required for this test.

Instructions

  1. The images and SRs submitteed by Acquistion Modality and Evidence Creator vendors are available via the Connectathon webtool on the MESA distribution page. It will also contain a worksheet that lists each Acquisition Modality and Evidence Creator actor in the MAMMO profile.
  2. Upload all available datasets for this test.
  3. Store and display every object. including CAD marks as applicable, submitted by Modality and Evidence Creator vendors.
  4. Visually verify the accuracy of the display.
  5. Fill out the worksheet and indicate that you either successfully rendered each study or describe problems with the it.

Evaluation

  1. Rename the worksheet according to your system name.
  2. Place the worksheet in a zip file and upload it as the results for this test.

 

Supplemental Information

 

Appendix A

This appendix contains David Clunie’s additional notes on the datasets he assembled and which are used in these tests. 
These notes are informative to both the executors and evaluators of these tests.

Dataset 00100n Notes

This dataset is derived from images of the same woman with sensors from different vendors, but edited in order to:

Dataset 004001-2 Notes

Dataset 007001-2 Notes

Dataset 009001 Notes

Dataset 009002 Notes

Dataset 009003 Notes

Dataset 009004 Notes

Dataset 009005 Notes

Dataset 011001 Notes

Dataset 012001 Notes

Dataset 013001 Notes

Dataset 013002 Notes

Dataset 013003 Notes