Difference between revisions of "Publications/lazzara.13.ijdar.inc"

From LRDE

(Use {{SERVER}} instead of a static url like http://www.lrde.epita.fr/)
 
(7 intermediate revisions by the same user not shown)
Line 16: Line 16:
 
''git clone git://git.lrde.epita.fr/olena -b papers/lazzara.13.ijdar && cd olena/scribo/scribo/binarization''
 
''git clone git://git.lrde.epita.fr/olena -b papers/lazzara.13.ijdar && cd olena/scribo/scribo/binarization''
   
* [http://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar Evaluation outputs] (detailed hereinafter).
+
* [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar Evaluation outputs] (detailed hereinafter).
  +
* [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar Evaluation outputs] (detailed hereinafter).
   
 
This algorithm is also part of the generic image processing platform [[Olena]]
 
This algorithm is also part of the generic image processing platform [[Olena]]
Line 49: Line 50:
 
| 14.084
 
| 14.084
 
| 4.5068
 
| 4.5068
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/dibco_2009_sauvola_ms_k.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/dibco_2009_sauvola_ms_k.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/dibco_2009_sauvola_ms_k.zip Outputs]
   
 
|-
 
|-
Line 61: Line 63:
 
| 9.510
 
| 9.510
 
| 1.82
 
| 1.82
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/hdibco_2010_sauvola_ms_k.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/hdibco_2010_sauvola_ms_k.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/hdibco_2010_sauvola_ms_k.zip Outputs]
   
 
|-
 
|-
Line 73: Line 76:
 
| 8.156
 
| 8.156
 
| 11.5355
 
| 11.5355
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/dibco_2011_sauvola_ms_k.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/dibco_2011_sauvola_ms_k.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/dibco_2011_sauvola_ms_k.zip Outputs]
   
 
|-
 
|-
Line 85: Line 89:
 
| 10.368
 
| 10.368
 
| 2.79
 
| 2.79
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/hdibco_2012_sauvola_ms_k.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/hdibco_2012_sauvola_ms_k.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/hdibco_2012_sauvola_ms_k.zip Outputs]
   
 
|-
 
|-
Line 97: Line 102:
 
| 5.265
 
| 5.265
 
| 0.2405
 
| 0.2405
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/cmaterdb_6.1_sauvola_ms_k.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/cmaterdb_6.1_sauvola_ms_k.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/cmaterdb_6.1_sauvola_ms_k.zip Outputs]
   
 
|}
 
|}
Line 127: Line 133:
 
| 18.516
 
| 18.516
 
| 8.9698
 
| 8.9698
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/dibco_2009_sauvola_ms_kx.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/dibco_2009_sauvola_ms_kx.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/dibco_2009_sauvola_ms_kx.zip Outputs]
   
 
|-
 
|-
Line 139: Line 146:
 
| 6.896
 
| 6.896
 
| 3.42
 
| 3.42
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/hdibco_2010_sauvola_ms_kx.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/hdibco_2010_sauvola_ms_kx.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/hdibco_2010_sauvola_ms_kx.zip Outputs]
   
 
|-
 
|-
Line 151: Line 159:
 
| 11.669
 
| 11.669
 
| 20.4354
 
| 20.4354
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/dibco_2011_sauvola_ms_kx.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/dibco_2011_sauvola_ms_kx.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/dibco_2011_sauvola_ms_kx.zip Outputs]
   
 
|-
 
|-
Line 163: Line 172:
 
| 8.369
 
| 8.369
 
| 5.34
 
| 5.34
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/hdibco_2012_sauvola_ms_kx.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/hdibco_2012_sauvola_ms_kx.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/hdibco_2012_sauvola_ms_kx.zip Outputs]
   
 
|-
 
|-
Line 175: Line 185:
 
| 3.775
 
| 3.775
 
| 0.8408
 
| 0.8408
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/cmaterdb_6.1_sauvola_ms_kx.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/cmaterdb_6.1_sauvola_ms_kx.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/cmaterdb_6.1_sauvola_ms_kx.zip Outputs]
   
 
|}
 
|}
Line 195: Line 206:
 
|-
 
|-
 
! align="center" | Method
 
! align="center" | Method
! Clean documents</strong
+
! Clean documents
! Scanned documents</strong
+
! Scanned documents
! Original documents</strong
+
! Original documents
   
 
|-
 
|-
! [[Publications/#sauvola2000|Sauvola]]
+
! [[#sauvola2000|Sauvola]]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_clean.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_scanned.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_orig.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_orig.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_orig.zip Outputs]
   
 
|-
 
|-
! Sauvola MS_kx</strong
+
! Sauvola MS_kx
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_kx_clean.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_kx_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_kx_scanned.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_kx_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_kx_orig.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_kx_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_kx_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_kx_orig.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_kx_orig.zip Outputs]
   
 
|-
 
|-
 
! Sauvola MS_k
 
! Sauvola MS_k
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_k_clean.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_k_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_k_scanned.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_k_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_k_orig.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_k_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_k_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_k_orig.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_ms_k_orig.zip Outputs]
   
 
|-
 
|-
! [[Publications/#wolf2004|Wolf]]
+
! [[#wolf2004|Wolf]]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_wolf_clean.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_wolf_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_wolf_scanned.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_wolf_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_wolf_orig.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_wolf_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_wolf_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_wolf_orig.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_wolf_orig.zip Outputs]
   
 
|-
 
|-
! [[Publications/#otsu1975|Otsu]]
+
! [[#otsu1975|Otsu]]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_otsu_clean.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_otsu_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_otsu_scanned.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_otsu_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_otsu_orig.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_otsu_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_otsu_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_otsu_orig.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_otsu_orig.zip Outputs]
   
 
|-
 
|-
! [[Publications/#niblack1985|Niblack]]
+
! [[#niblack1985|Niblack]]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_niblack_clean.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_niblack_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_niblack_scanned.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_niblack_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_niblack_orig.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_niblack_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_niblack_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_niblack_orig.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_niblack_orig.zip Outputs]
   
 
|-
 
|-
! [[Publications/#kim2004|Kim]]
+
! [[#kim2004|Kim]]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_kim_clean.zip>Outputs</a>
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_kim_clean.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_kim_clean.zip Outputs]
| <a Outputs]
 
| <a href=https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_kim_orig.zip>Outputs</a>
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_kim_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_kim_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_kim_org.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_kim_org.zip Outputs]
   
 
|-
 
|-
! [[Publications/#fabrizio2009|TMMS]]
+
! [[#fabrizio2009|TMMS]]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_tmms_clean.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_tmms_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_tmms_scanned.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_tmms_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_tmms_orig.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_tmms_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_tmms_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_tmms_orig.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_tmms_orig.zip Outputs]
   
 
|-
 
|-
! [[Publications/#farrahi2010|Sauvola MsGb]]
+
! [[#farrahi2010|Sauvola MsGb]]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_msgb_clean.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_msgb_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_msgb_scanned.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_msgb_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_msgb_orig.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_msgb_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_msgb_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_msgb_orig.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_sauvola_msgb_orig.zip Outputs]
   
 
|-
 
|-
! [[Publications/#su2011|Su 2011]]
+
! [[#su2011|Su 2011]]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_su_2011_clean.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_su_2011_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_su_2011_scanned.zip Outputs] (1)
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_su_2011_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_su_2011_orig.zip Outputs] (2)
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_su_2011_scanned.zip Outputs] (1)
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_su_2011_scanned.zip Outputs] (1)
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_su_2011_orig.zip Outputs] (2)
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_su_2011_orig.zip Outputs] (2)
   
 
|-
 
|-
! [[Publications/#lelore2011|Lelore]]
+
! [[#lelore2011|Lelore]]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_lelore_clean.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_lelore_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_lelore_scanned.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_lelore_clean.zip Outputs]
| [https://www.lrde.epita.fr/dload/olena/resources/lazzara.13.ijdar/bin_lelore_orig.zip Outputs]
+
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_lelore_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_lelore_scanned.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_lelore_orig.zip Outputs]
  +
| [{{SERVER}}/dload/olena/resources/lazzara.13.ijdar/bin_lelore_orig.zip Outputs]
   
 
|}
 
|}
Line 274: Line 318:
 
=== Pixel-based Accuracy Evaluation ===
 
=== Pixel-based Accuracy Evaluation ===
   
{| border="1"
+
{| class="wikitable"
 
|-
 
|-
| align="center" | <strong>Method</strong>
+
! align="center" | Method
| align="center" | <strong>Precision</strong>
+
! align="center" | Precision
| align="center" | <strong>Recall</strong>
+
! align="center" | Recall
| align="center" | <strong>F-Measure</strong>
+
! align="center" | F-Measure
| align="center" | <strong>Time (s)</strong>
+
! align="center" | Time (s)
   
 
|-
 
|-
| <strong>Sauvola MS_kx</strong>
+
! Sauvola MS_kx
| <strong>0.97</strong>
+
| 0.97
| <strong>0.94</strong>
+
| 0.94
| <strong>94.97</strong>
+
| 94.97
| <strong>170</strong>
+
| 170
   
 
|-
 
|-
| [[Publications/#lelore2011|Lelore]]
+
! [[#lelore2011|Lelore]]
 
| 0.99
 
| 0.99
 
| 0.88
 
| 0.88
Line 297: Line 341:
   
 
|-
 
|-
| Sauvola MS_k
+
! Sauvola MS_k
 
| 0.97
 
| 0.97
 
| 0.89
 
| 0.89
Line 304: Line 348:
   
 
|-
 
|-
| [[Publications/#fabrizio2009|TMMS]]
+
! [[#fabrizio2009|TMMS]]
 
| 0.90
 
| 0.90
 
| 0.95
 
| 0.95
Line 311: Line 355:
   
 
|-
 
|-
| [[Publications/#wolf2004|Wolf]]
+
! [[#wolf2004|Wolf]]
 
| 0.99
 
| 0.99
 
| 0.85
 
| 0.85
Line 318: Line 362:
   
 
|-
 
|-
| [[Publications/#otsu1975|Otsu]]
+
! [[#otsu1975|Otsu]]
 
| 0.98
 
| 0.98
 
| 0.84
 
| 0.84
Line 325: Line 369:
   
 
|-
 
|-
| <strong>[[Publications/#sauvola2000|Sauvola]]</strong>
+
! [[#sauvola2000|Sauvola]]
 
| 0.99
 
| 0.99
 
| 0.82
 
| 0.82
Line 332: Line 376:
   
 
|-
 
|-
| [[Publications/#kim2004|Kim]]
+
! [[#kim2004|Kim]]
 
| 0.99
 
| 0.99
 
| 0.82
 
| 0.82
Line 339: Line 383:
   
 
|-
 
|-
| <strong>[[Publications/#farrahi2010|Sauvola MsGb]]</strong>
+
! [[#farrahi2010|Sauvola MsGb]]
 
| 0.99
 
| 0.99
 
| 0.82
 
| 0.82
Line 346: Line 390:
   
 
|-
 
|-
| [[Publications/#niblack1985|Niblack]]
+
! [[#niblack1985|Niblack]]
 
| 0.89
 
| 0.89
 
| 0.91
 
| 0.91
Line 353: Line 397:
   
 
|-
 
|-
| <a href='#su2011'>Su 2011</a>
+
! [[#su2011|Su 2011]]
 
| 0.98
 
| 0.98
 
| 0.80
 
| 0.80
Line 366: Line 410:
 
=== OCR-based Evaluation ===
 
=== OCR-based Evaluation ===
   
  +
{| class="wikitable"
<!--
 
{| border="1"
 
 
|-
 
|-
| align="center" | <strong>Method</strong>
+
! align="center" | Method
| colspan="9" align="center" | <strong>OCR error (%)</strong
+
! colspan="9" align="center" | OCR error (%)
   
 
|-
 
|-
| align="right" style="font-size:8pt" | <strong>Set &rarr;</strong>
+
! align="right" style="font-size:8pt" | Set &rarr;
| colspan="3" | <strong>Clean documents</strong
+
! colspan="3" | Clean documents
| colspan="3" | <strong>Scanned documents</strong
+
! colspan="3" | Scanned documents
| colspan="3" | <strong>Original documents</strong
+
! colspan="3" | Original documents
   
 
|-
 
|-
| align="right" style="font-size:8pt" | <strong>Subset &rarr;</strong>
+
! align="right" style="font-size:8pt" | Subset &rarr;
  +
! S
| <strong>S</strong
 
  +
! M
| <strong>M</strong
 
  +
! L
| <strong>L</strong
 
  +
! S
| <strong>S</strong
 
  +
! M
| <strong>M</strong
 
  +
! L
| <strong>L</strong
 
  +
! S
| <strong>S</strong
 
  +
! M
| <strong>M</strong
 
  +
! L
| <strong>L</strong
 
   
 
|-
 
|-
| <strong>[http://www.sciencedirect.com/science/article/pii/S0031320399000552 Sauvola]</strong>
+
! [http://www.sciencedirect.com/science/article/pii/S0031320399000552 Sauvola]
| 3.79
 
| 4.08
 
| 10.35
 
| 7.31
 
| 5.85
 
| 9.47
 
| 3.80
 
| 4.07
 
| 11.93
 
 
|-
 
| <strong> Sauvola MS_kx</strong
 
| 3.75
 
| 3.46
 
| 7.64
 
| 6.70
 
| 4.83
 
| 7.51
 
| 3.71
 
| 3.43
 
| 8.71
 
 
|-
 
| <strong>Sauvola MS_k</strong>
 
| 3.80
 
| 4.02
 
| 7.64
 
| 7.17
 
| 5.45
 
| 7.32
 
| 3.79
 
| 3.97
 
| 8.84
 
 
|-
 
| <strong>[[Publications/#wolf2004|Wolf]]</strong>
 
| 3.76
 
| 3.72
 
| 9.34
 
| 7.17
 
| 5.46
 
| 9.09
 
| 3.79
 
| 4.06
 
| 10.86
 
 
|-
 
| <strong>[[Publications/#otsu1975|Otsu]]</strong>
 
| 4.03
 
| 4.88
 
| 7.77
 
| 8.19
 
| 5.50
 
| 8.02
 
| 4.03
 
| 5.00
 
| 9.03
 
 
|-
 
| <strong>[[Publications/#niblack1985|Niblack]]</strong>
 
| 4.01
 
| 3.45
 
| 10.29
 
| 6.41
 
| 8.31
 
| 16.10
 
| 4.00
 
| 3.42
 
| 12.00
 
 
|-
 
| <strong>[[Publications/#kim2004|Kim]]</strong>
 
| 4.17
 
| 4.93
 
| 8.52
 
| 9.62
 
| 8.01
 
| 10.67
 
| 4.18
 
| 4.92
 
| 10.04
 
 
|-
 
| <strong>[[Publications/#fabrizio2009|TMMS]]</strong>
 
| 3.75
 
| 3.35
 
| 8.90
 
| 21.23
 
| 15.75
 
| 66.35
 
| 3.74
 
| 3.35
 
| 9.53
 
 
|-
 
| <strong>[[Publications/#farrahi2010|Sauvola MsGb]]</strong>
 
| 7.01
 
| 9.94
 
| 13.13
 
| 20.20
 
| 11.29
 
| 14.77
 
| 7.85
 
| 7.92
 
| 10.73
 
 
|-
 
| <strong>[[Publications/#su2011|Su 2011]]</strong>
 
| 7.65
 
| 11.96
 
| 46.72
 
| 12.35
 
| 15.29 (3)
 
| 48.61 (3)
 
| 5.77 (4)
 
| 12.40 (4)
 
| 45.52 (4)
 
 
|-
 
| <strong><a href='#lelore2011'>Lelore</a></strong>
 
| 3.99
 
| 3.27
 
| 8.21
 
| 12.35
 
| 5.56
 
| 13.51
 
| 3.96
 
| 3.37
 
| 8.59
 
 
|} -->
 
 
{| border="1"
 
|-
 
| align="center" | <strong>Method</strong>
 
| colspan="9" align="center" | <strong>OCR error (%)</strong
 
 
|-
 
| align="right" style="font-size:8pt" | <strong>Set &rarr;</strong>
 
| colspan="3" | <strong>Clean documents</strong
 
| colspan="3" | <strong>Scanned documents</strong
 
| colspan="3" | <strong>Original documents</strong
 
 
|-
 
| align="right" style="font-size:8pt" | <strong>Subset &rarr;</strong>
 
| <strong>S</strong
 
| <strong>M</strong
 
| <strong>L</strong
 
| <strong>S</strong
 
| <strong>M</strong
 
| <strong>L</strong
 
| <strong>S</strong
 
| <strong>M</strong
 
| <strong>L</strong
 
 
|-
 
| <strong>[http://www.sciencedirect.com/science/article/pii/S0031320399000552 Sauvola]</strong>
 
 
| 2.62
 
| 2.62
 
| 2.61
 
| 2.61
Line 560: Line 446:
   
 
|-
 
|-
| <strong>Sauvola Ms_kx</strong>
+
! Sauvola Ms_kx
 
| 2.59
 
| 2.59
 
| 2.21
 
| 2.21
Line 572: Line 458:
   
 
|-
 
|-
| <strong>Sauvola Ms_k</strong>
+
! Sauvola Ms_k
 
| 2.64
 
| 2.64
 
| 2.60
 
| 2.60
Line 584: Line 470:
   
 
|-
 
|-
| <strong>[[Publications/#wolf2004|Wolf]]</strong>
+
! [[#wolf2004|Wolf]]
 
| 2.60
 
| 2.60
 
| 2.42
 
| 2.42
Line 596: Line 482:
   
 
|-
 
|-
  +
! [[#otsu1975|Otsu]]
|
 
<strong>[[Publications/#otsu1975|Otsu]]</strong>
 
 
| 3.09
 
| 3.09
 
| 2.55
 
| 2.55
Line 609: Line 494:
   
 
|-
 
|-
  +
! [[#niblack1985|Niblack]]
|
 
<strong>[[Publications/#niblack1985|Niblack]]</strong>
 
 
| 2.68
 
| 2.68
 
| 2.28
 
| 2.28
Line 622: Line 506:
   
 
|-
 
|-
  +
! [[#kim2004|Kim]]
|
 
<strong>[[Publications/#kim2004|Kim]]</strong>
 
 
| 2.79
 
| 2.79
 
| 3.01
 
| 3.01
Line 635: Line 518:
   
 
|-
 
|-
| <strong>[[Publications/#fabrizio2009|TMMS]]</strong>
+
! [[#fabrizio2009|TMMS]]
 
| 2.61
 
| 2.61
 
| 2.43
 
| 2.43
Line 647: Line 530:
   
 
|-
 
|-
| <strong>[[Publications/#farrahi2010|Sauvola MsGb]]</strong>
+
! [[#farrahi2010|Sauvola MsGb]]
 
| 5.45
 
| 5.45
 
| 5.14
 
| 5.14
Line 659: Line 542:
   
 
|-
 
|-
| <strong>[[Publications/#su2011|Su 2011]]</strong>
+
! [[#su2011|Su 2011]]
 
| 2.95
 
| 2.95
 
| 5.01
 
| 5.01
Line 671: Line 554:
   
 
|-
 
|-
  +
! Lelore
| <strong><a href='#lelore2011'>Lelore</a></strong>
 
 
| 2.46
 
| 2.46
 
| 2.21
 
| 2.21
Line 688: Line 571:
 
(4) Due to program crashes, those scores do not include the results of 9 large text lines out of 123, 9 medium text lines out of 320, 432 small text lines out of 9551.
 
(4) Due to program crashes, those scores do not include the results of 9 large text lines out of 123, 9 medium text lines out of 320, 432 small text lines out of 9551.
   
  +
<gallery widths=500px heights=300px>
[[File:Publications-sauvola_webcharts.png|400px]]
 
  +
File:Publications-sauvola_webcharts.png
<hr width='600px' align='left'/>
 
  +
File:Publications-sota_webcharts.png
 
[[File:Publications-sota_webcharts.png|400px]]
+
File:Publications-sota2_webcharts.png
  +
File:Publications-sota3_webcharts.png
<hr width='600px' align='left'/>
 
  +
</gallery>
 
[[File:Publications-sota2_webcharts.png|400px]]
 
<hr width='600px' align='left'/>
 
 
[[File:Publications-sota3_webcharts.png|400px]]
 
   
 
== References ==
 
== References ==
   
* <a id='fabrizio2009'/> '''[Fabrizio2009]''' J. Fabrizio, B. Marcotegui, M. Cord, Text segmentation in natural scenes using Toggle-Mapping, in the proceedings of the International Conference on Image Processing (ICIP), 2009, pp.2373-2376. [http://dx.doi.org/10.1109/ICIP.2009.5413435 DOI: 10.1109/ICIP.2009.5413435]
+
* {{anchor|fabrizio2009}} '''[Fabrizio2009]''' J. Fabrizio, B. Marcotegui, M. Cord, Text segmentation in natural scenes using Toggle-Mapping, in the proceedings of the International Conference on Image Processing (ICIP), 2009, pp.2373-2376. [http://dx.doi.org/10.1109/ICIP.2009.5413435 DOI: 10.1109/ICIP.2009.5413435]
  +
* {{anchor|farrahi2010}} '''[Farrahi2010]''' R. Farrahi Moghaddam, M. Cheriet, A multi-scale framework for adaptive binarization of degraded document images, Pattern Recognition 43, 2010, 2186-2198. [http://dx.doi.org/10.1016/j.patcog.2009.12.024 DOI: 10.1016/j.patcog.2009.12.024] [http://www.synchromedia.ca/web/reza/expres/MsGb_Sauvola website].
{| border="1"
 
  +
* {{anchor|kim2004}} '''[Kim2004]''' In-Jung Kim, Multi-window binarization of camera image for document recognition, in the proceedings of the International Workshop on Frontiers in Handwriting Recognition, 2004, pp. 323- 327. [http://dx.doi.org/10.1109/IWFHR.2004.70 DOI: 10.1109/IWFHR.2004.70]
|-
 
  +
* {{anchor|lelore2011}} '''[Lelore2011]''' T. Lelore, F. Bouchara, Super-resolved binarization of text based on the FAIR algorithm, in the proceedings of the International Conference on Document Analysis and Recognition, 2011, pp.839-843. [http://dx.doi.org/10.1109/ICDAR.2011.172 DOI: 10.1109/ICDAR.2011.172]
* <a id='farrahi2010'/> '''[Farrahi2010]''' R. Farrahi Moghaddam, M. Cheriet, A multi-scale framework for adaptive binarization of degraded document images, Pattern Recognition 43, 2010, 2186-2198. [http://dx.doi.org/10.1016/j.patcog.2009.12.024 DOI: 10.1016/j.patcog.2009.12.024] || [http://www.synchromedia.ca/web/reza/expres/MsGb_Sauvola website].
 
  +
* {{anchor|niblack1985}} '''[Niblack1985]''' W. Niblack, An introduction to digital image processing, Strandberg Publishing Company Birkeroed, 1985, ISBN: 87-872-0055-4.
|}
 
  +
* {{anchor|otsu1975}} '''[Otsu1975]''' N. Otsu, A threshold selection method from gray-level histograms, IEEE Transactions on Systems, Man and Cybernetics, Vol. 9, No. 1., January 1979, pp. 62-66.
 
* <a id='kim2004'/> '''[Kim2004]''' In-Jung Kim, Multi-window binarization of camera image for document recognition, in the proceedings of the International Workshop on Frontiers in Handwriting Recognition, 2004, pp. 323- 327. [http://dx.doi.org/10.1109/IWFHR.2004.70 DOI: 10.1109/IWFHR.2004.70]
+
* {{anchor|sauvola2000}} '''[Sauvola2000]''' J. Sauvola, M. Pietikäinen, Adaptive document image binarization, Pattern Recognition, Volume 33, Issue 2, February 2000, Pages 225-236, ISSN 0031-3203, [http://dx.doi.org/10.1016/S0031-3203(99)00055-2 DOI: 10.1016/S0031-3203(99)00055-2].
* <a id='lelore2011'/> '''[Lelore2011]''' T. Lelore, F. Bouchara, Super-resolved binarization of text based on the FAIR algorithm, in the proceedings of the International Conference on Document Analysis and Recognition, 2011, pp.839-843. [http://dx.doi.org/10.1109/ICDAR.2011.172 DOI: 10.1109/ICDAR.2011.172]
+
* {{anchor|su2011}} '''[Su2011]''' B. Su, S. Lu, C. L. Tan, Binarization of historical document images using the local maximum and minimum, in the proceedings of the International Workshop on Document Analysis Systems, pages 159-166, 2010, ISBN: 978-1-60558-773-8, DOI: [http://dx.doi.org/10.1145/1815330.1815351 10.1145/1815330.1815351] [http://www.comp.nus.edu.sg/~subolan/binarization/ website].
  +
* {{anchor|wolf2004}} '''[Wolf2004]''' C. Wolf, J.-M. Jolion, extraction and recognition of artificial text in multimedia documents, Pattern Analysis & Applications, Springer London, Issn: 1433-7541, pp.309-326, volume: 6, issue: 4, DOI: [http://dx.doi.org/10.1007/s10044-003-0197-7 10.1007/s10044-003-0197-7].
* <a id='niblack1985'/> '''[Niblack1985]''' W. Niblack, An introduction to digital image processing, Strandberg Publishing Company Birkeroed, 1985, ISBN: 87-872-0055-4.
 
* <a id='otsu1975'/> '''[Otsu1975]''' N. Otsu, A threshold selection method from gray-level histograms, IEEE Transactions on Systems, Man and Cybernetics, Vol. 9, No. 1., January 1979, pp. 62-66.
 
* <a id='sauvola2000'/> '''[Sauvola2000]''' J. Sauvola, M. Pietikäinen, Adaptive document image binarization, Pattern Recognition, Volume 33, Issue 2, February 2000, Pages 225-236, ISSN 0031-3203, [http://dx.doi.org/10.1016/S0031-3203(99)00055-2 DOI: 10.1016/S0031-3203(99)00055-2].
 
{| border="1"
 
|-
 
* <a id='su2011'/> '''[Su2011]''' B. Su, S. Lu, C. L. Tan, Binarization of historical document images using the local maximum and minimum, in the proceedings of the International Workshop on Document Analysis Systems, pages 159-166, 2010, ISBN: 978-1-60558-773-8, DOI: [http://dx.doi.org/10.1145/1815330.1815351 10.1145/1815330.1815351] || [http://www.comp.nus.edu.sg/~subolan/binarization/ website].
 
|}
 
 
* <a id='wolf2004'/> '''[Wolf2004]''' C. Wolf, J.-M. Jolion, extraction and recognition of artificial text in multimedia documents, Pattern Analysis & Applications, Springer London, Issn: 1433-7541, pp.309-326, volume: 6, issue: 4, DOI: [http://dx.doi.org/10.1007/s10044-003-0197-7 10.1007/s10044-003-0197-7].
 

Latest revision as of 15:57, 26 February 2014


Resources

  • Source code (under GPL v2 licence) :
git clone git://git.lrde.epita.fr/olena -b papers/lazzara.13.ijdar && cd olena/scribo/scribo/binarization

This algorithm is also part of the generic image processing platform Olena

Outputs and Scores on classical datasets

Pixel-based Accuracy Evaluation

1. Sauvola MS_k

Dataset Recall p-Recall Precision F-measure (± std) p-FM (± std) PSNR DRD MPM Outputs
DIBCO'09 88.4088
-
76.3713 78.08 (± 18.498)
-
15.2386 14.084 4.5068 Outputs Outputs
H-DIBCO'10 52.9688 63.2666 83.6741 61.17 (± 25.326) 69.45 (± 26.880) 14.72 9.510 1.82 Outputs Outputs
DIBCO'11 79.3667
-
83.9283 79.31 (± 11.711)
-
15.33 8.156 11.5355 Outputs Outputs
H-DIBCO'12 66.5586 73.3397 88.0996 69.56 (± 18.316) 74.78 (± 17.063) 15.12 10.368 2.79 Outputs Outputs
CMATERdb 6.1 82.1535
-
95.2257 87.20 (± 8.872)
-
17.10 5.265 0.2405 Outputs Outputs


2. Sauvola MS_kx

Dataset Recall p-Recall Precision F-measure (± std) pF-measure (± std) PSNR DRD MPM Outputs
DIBCO'09 95.1858
-
69.2059 76.85 (± 20.277)
-
14.52 18.516 8.9698 Outputs Outputs
H-DIBCO'10 77.1109 88.8740 88.3846 80.03 (± 9.269) 87.07 (± 10.262) 16.36 6.896 3.42 Outputs Outputs
DIBCO'11 89.7931
-
75.0818 79.70 (± 12.689)
-
14.91 11.669 20.4354 Outputs Outputs
H-DIBCO'12 83.7305 84.6084 91.8082 81.77 (± 8.765) 86.41 (± 9.768) 16.51 8.369 5.34 Outputs Outputs
CMATERdb 6.1 91.4903
-
91.6986 91.34 (± 4.232)
-
18.18 3.775 0.8408 Outputs Outputs

These evaluation shows that our multiscale algorithm is equivalent to the classical Sauvola on historical documents. This result was expected as this algorithm is designed for magazines.

Outputs and Scores on LRDE's Document Binarization Dataset

Results have been produced using LRDE's Document Binarization Dataset (DBD) version 1.0.

Please refer to the article to know how they have been produced and what are the different document qualities.


Binary Outputs

Method Clean documents Scanned documents Original documents
Sauvola Outputs Outputs Outputs Outputs Outputs Outputs
Sauvola MS_kx Outputs Outputs Outputs Outputs Outputs Outputs
Sauvola MS_k Outputs Outputs Outputs Outputs Outputs Outputs
Wolf Outputs Outputs Outputs Outputs Outputs Outputs
Otsu Outputs Outputs Outputs Outputs Outputs Outputs
Niblack Outputs Outputs Outputs Outputs Outputs Outputs
Kim Outputs Outputs Outputs Outputs Outputs Outputs
TMMS Outputs Outputs Outputs Outputs Outputs Outputs
Sauvola MsGb Outputs Outputs Outputs Outputs Outputs Outputs
Su 2011 Outputs Outputs Outputs (1) Outputs (1) Outputs (2) Outputs (2)
Lelore Outputs Outputs Outputs Outputs Outputs Outputs


(1) Due to program crashes, one output image is missing (page 103).

(2) Due to program crashes, one output image is missing (pages 43, 46, 80, 90, 94, 151)

Pixel-based Accuracy Evaluation

Method Precision Recall F-Measure Time (s)
Sauvola MS_kx 0.97 0.94 94.97 170
Lelore 0.99 0.88 92.9 1625
Sauvola MS_k 0.97 0.89 92.10 170
TMMS 0.90 0.95 91.97 250
Wolf 0.99 0.85 91.38 125
Otsu 0.98 0.84 90.33 67
Sauvola 0.99 0.82 89.67 155
Kim 0.99 0.82 89.34 260
Sauvola MsGb 0.99 0.82 89.29 31h
Niblack 0.89 0.91 88.79 170
Su 2011 0.98 0.80 87.3 8800

This evaluation shows that state-of-the-art implementations, like Su 2011, do not handle magazines correctly. The main issues encountered by all the methods are related to large objects and the fact that parameters do not fit to the contents. Our multiscale approach succeeds in improving classical Sauvola algorithm results because large objects are correctly retrieved. The computation time corresponds to the approximate total time needed to compute the whole 125 document binarization. All time measures have been performed on the same computer with an Intel Xeon W3520@2,67Ghz with 6GB of RAM, except for Lelore' method of which time was measured on an Intel i7 860@2,8Ghz.

OCR-based Evaluation

Method OCR error (%)
Set → Clean documents Scanned documents Original documents
Subset → S M L S M L S M L
Sauvola 2.62 2.61 6.00 5.49 3.87 7.75 2.62 2.61 6.90
Sauvola Ms_kx 2.59 2.21 4.83 5.14 2.74 5.68 2.54 2.28 5.25
Sauvola Ms_k 2.64 2.60 4.78 5.44 3.20 5.15 2.64 2.53 5.41
Wolf 2.60 2.42 5.04 5.14 3.43 6.53 2.61 2.52 6.48
Otsu 3.09 2.55 4.56 6.23 3.58 5.73 2.95 2.90 5.79
Niblack 2.68 2.28 6.79 4.96 5.15 12.79 2.68 2.28 7.80
Kim 2.79 3.01 5.47 7.03 5.08 7.80 2.78 3.01 6.37
TMMS 2.61 2.43 5.25 18.17 11.44 54.83 2.61 2.45 5.84
Sauvola MsGb 5.45 5.14 9.29 9.49 8.40 10.35 6.14 3.93 6.00
Su 2011 2.95 5.01 15.39 7.42 8.54 (3) 31.58 (3) 3.09 (4) 6.24 (4) 17.87 (4)
Lelore 2.46 2.21 4.88 8.01 3.44 8.65 2.51 2.22 4.88

(3) Due to program crashes, those scores do not include the results of 2 medium text lines out of 320 and of 57 small text lines out of 9551.

(4) Due to program crashes, those scores do not include the results of 9 large text lines out of 123, 9 medium text lines out of 320, 432 small text lines out of 9551.

References

  • [Fabrizio2009] J. Fabrizio, B. Marcotegui, M. Cord, Text segmentation in natural scenes using Toggle-Mapping, in the proceedings of the International Conference on Image Processing (ICIP), 2009, pp.2373-2376. DOI: 10.1109/ICIP.2009.5413435
  • [Farrahi2010] R. Farrahi Moghaddam, M. Cheriet, A multi-scale framework for adaptive binarization of degraded document images, Pattern Recognition 43, 2010, 2186-2198. DOI: 10.1016/j.patcog.2009.12.024 website.
  • [Kim2004] In-Jung Kim, Multi-window binarization of camera image for document recognition, in the proceedings of the International Workshop on Frontiers in Handwriting Recognition, 2004, pp. 323- 327. DOI: 10.1109/IWFHR.2004.70
  • [Lelore2011] T. Lelore, F. Bouchara, Super-resolved binarization of text based on the FAIR algorithm, in the proceedings of the International Conference on Document Analysis and Recognition, 2011, pp.839-843. DOI: 10.1109/ICDAR.2011.172
  • [Niblack1985] W. Niblack, An introduction to digital image processing, Strandberg Publishing Company Birkeroed, 1985, ISBN: 87-872-0055-4.
  • [Otsu1975] N. Otsu, A threshold selection method from gray-level histograms, IEEE Transactions on Systems, Man and Cybernetics, Vol. 9, No. 1., January 1979, pp. 62-66.
  • [Sauvola2000] J. Sauvola, M. Pietikäinen, Adaptive document image binarization, Pattern Recognition, Volume 33, Issue 2, February 2000, Pages 225-236, ISSN 0031-3203, DOI: 10.1016/S0031-3203(99)00055-2.
  • [Su2011] B. Su, S. Lu, C. L. Tan, Binarization of historical document images using the local maximum and minimum, in the proceedings of the International Workshop on Document Analysis Systems, pages 159-166, 2010, ISBN: 978-1-60558-773-8, DOI: 10.1145/1815330.1815351 website.
  • [Wolf2004] C. Wolf, J.-M. Jolion, extraction and recognition of artificial text in multimedia documents, Pattern Analysis & Applications, Springer London, Issn: 1433-7541, pp.309-326, volume: 6, issue: 4, DOI: 10.1007/s10044-003-0197-7.