hashcat
advanced password recovery

10x 7970, 4x 5970, 3x 6990, and a 5870. 4x SDR Infiniband interconnect. catalyst 12.8, vcl 1.15, vclHashcat-lite v0.11-rc1

Impressive numbers, interesting what would they be on GB lan, not infiniband.

They are lower on GigE -- not due to bandwidth, but due to latency. Ethernet latencies are too high.

(12-02-2012, 06:54 PM)epixoip Wrote: 10x 7970, 4x 5970, 3x 6990, and a 5870. 4x SDR Infiniband interconnect.

10x 7970 Wow ! :0

As I am a proud owner of a single HD5870, I like to think the inclusion of 1 x HD5870 made all the difference to your results

Ha ha !

The 5870 totally pushed it over the edge

wow thats awesome! i tried to get vcl working but i fail at linux and gave up. followed atom's wiki but keep getting "libOpenCL.so cannot be found" on the master.

Very impressive numbers! So vclhashcat-lite v0.11 will support mixed-GPUs.

Any idea when this will be released for the public?

(12-02-2012, 06:54 PM)epixoip Wrote: 10x 7970, 4x 5970, 3x 6990, and a 5870. 4x SDR Infiniband interconnect. catalyst 12.8, vcl 1.15, vclHashcat-lite v0.11-rc1

Code:

epixoip@token:~/oclHashcat-lite-0.11$ LD_LIBRARY_PATH=/usr/lib/vcl vclrun ./vclHashcat-lite64.bin -b --benchmark-mode 1 --force oclHashcat-lite v0.11 by atom starting... Password lengths: 1 - 54 Watchdog: Temperature abort trigger disabled Watchdog: Temperature retain trigger disabled Device #1: Tahiti, 2048MB, 1100Mhz, 32MCU Device #2: Tahiti, 2048MB, 1100Mhz, 32MCU Device #3: Cypress, 512MB, 830Mhz, 20MCU Device #4: Tahiti, 2048MB, 1100Mhz, 32MCU Device #5: Cypress, 512MB, 830Mhz, 20MCU Device #6: Tahiti, 2048MB, 1100Mhz, 32MCU Device #7: Cypress, 512MB, 830Mhz, 20MCU Device #8: Tahiti, 2048MB, 1100Mhz, 32MCU Device #9: Cypress, 512MB, 830Mhz, 20MCU Device #10: Cayman, 1024MB, 880Mhz, 24MCU Device #11: Tahiti, 2048MB, 1100Mhz, 32MCU Device #12: Cypress, 512MB, 830Mhz, 20MCU Device #13: Cayman, 1024MB, 880Mhz, 24MCU Device #14: Tahiti, 2048MB, 1100Mhz, 32MCU Device #15: Cypress, 512MB, 830Mhz, 20MCU Device #16: Cayman, 1024MB, 880Mhz, 24MCU Device #17: Tahiti, 2048MB, 1100Mhz, 32MCU Device #18: Cypress, 512MB, 830Mhz, 20MCU Device #19: Cayman, 1024MB, 880Mhz, 24MCU Device #20: Tahiti, 2048MB, 1100Mhz, 32MCU Device #21: Cypress, 512MB, 830Mhz, 20MCU Device #22: Cayman, 1024MB, 880Mhz, 24MCU Device #23: Tahiti, 2048MB, 1100Mhz, 32MCU Device #24: Cypress, 512MB, 830Mhz, 20MCU Device #25: Cayman, 1024MB, 880Mhz, 24MCU [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: MD5 Speed.GPU.#1.: 9593.3M/s Speed.GPU.#2.: 9595.6M/s Speed.GPU.#3.: 5565.1M/s Speed.GPU.#4.: 9577.7M/s Speed.GPU.#5.: 5569.4M/s Speed.GPU.#6.: 9591.6M/s Speed.GPU.#7.: 5568.7M/s Speed.GPU.#8.: 9577.6M/s Speed.GPU.#9.: 5564.6M/s Speed.GPU.#10.: 5668.3M/s Speed.GPU.#11.: 9589.5M/s Speed.GPU.#12.: 5900.0M/s Speed.GPU.#13.: 5670.6M/s Speed.GPU.#14.: 9569.5M/s Speed.GPU.#15.: 5546.8M/s Speed.GPU.#16.: 5668.6M/s Speed.GPU.#17.: 9469.2M/s Speed.GPU.#18.: 5548.9M/s Speed.GPU.#19.: 5666.1M/s Speed.GPU.#20.: 9485.5M/s Speed.GPU.#21.: 5547.9M/s Speed.GPU.#22.: 5670.2M/s Speed.GPU.#23.: 9493.5M/s Speed.GPU.#24.: 5545.0M/s Speed.GPU.#25.: 5668.8M/s Speed.GPU.#*.: 179.9G/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: md5($pass.$salt) Speed.GPU.#1.: 9585.7M/s Speed.GPU.#2.: 9602.7M/s Speed.GPU.#3.: 5555.4M/s Speed.GPU.#4.: 9571.7M/s Speed.GPU.#5.: 5548.5M/s Speed.GPU.#6.: 9602.1M/s Speed.GPU.#7.: 5545.1M/s Speed.GPU.#8.: 9561.4M/s Speed.GPU.#9.: 5545.5M/s Speed.GPU.#10.: 5668.1M/s Speed.GPU.#11.: 9562.3M/s Speed.GPU.#12.: 5893.3M/s Speed.GPU.#13.: 5664.2M/s Speed.GPU.#14.: 9598.6M/s Speed.GPU.#15.: 5523.8M/s Speed.GPU.#16.: 5663.2M/s Speed.GPU.#17.: 9459.2M/s Speed.GPU.#18.: 5537.0M/s Speed.GPU.#19.: 5665.0M/s Speed.GPU.#20.: 9458.0M/s Speed.GPU.#21.: 5548.5M/s Speed.GPU.#22.: 5663.9M/s Speed.GPU.#23.: 9466.4M/s Speed.GPU.#24.: 5528.9M/s Speed.GPU.#25.: 5666.6M/s Speed.GPU.#*.: 179.7G/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: Joomla Speed.GPU.#1.: 9584.5M/s Speed.GPU.#2.: 9587.8M/s Speed.GPU.#3.: 5546.6M/s Speed.GPU.#4.: 9571.9M/s Speed.GPU.#5.: 5558.9M/s Speed.GPU.#6.: 9578.7M/s Speed.GPU.#7.: 5547.1M/s Speed.GPU.#8.: 9596.0M/s Speed.GPU.#9.: 5543.5M/s Speed.GPU.#10.: 5660.8M/s Speed.GPU.#11.: 9593.0M/s Speed.GPU.#12.: 5890.1M/s Speed.GPU.#13.: 5667.2M/s Speed.GPU.#14.: 9593.1M/s Speed.GPU.#15.: 5519.8M/s Speed.GPU.#16.: 5666.2M/s Speed.GPU.#17.: 9510.3M/s Speed.GPU.#18.: 5532.6M/s Speed.GPU.#19.: 5662.1M/s Speed.GPU.#20.: 9504.3M/s Speed.GPU.#21.: 5539.4M/s Speed.GPU.#22.: 5666.0M/s Speed.GPU.#23.: 9497.4M/s Speed.GPU.#24.: 5527.4M/s Speed.GPU.#25.: 5663.3M/s Speed.GPU.#*.: 179.8G/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: SHA1 Speed.GPU.#1.: 3373.3M/s Speed.GPU.#2.: 3367.7M/s Speed.GPU.#3.: 1945.9M/s Speed.GPU.#4.: 3364.4M/s Speed.GPU.#5.: 1945.7M/s Speed.GPU.#6.: 3367.9M/s Speed.GPU.#7.: 1947.0M/s Speed.GPU.#8.: 3370.9M/s Speed.GPU.#9.: 1946.7M/s Speed.GPU.#10.: 1958.5M/s Speed.GPU.#11.: 3366.8M/s Speed.GPU.#12.: 2062.6M/s Speed.GPU.#13.: 1958.3M/s Speed.GPU.#14.: 3370.2M/s Speed.GPU.#15.: 1944.9M/s Speed.GPU.#16.: 1957.3M/s Speed.GPU.#17.: 3362.9M/s Speed.GPU.#18.: 1945.2M/s Speed.GPU.#19.: 1957.5M/s Speed.GPU.#20.: 3362.4M/s Speed.GPU.#21.: 1945.1M/s Speed.GPU.#22.: 1958.0M/s Speed.GPU.#23.: 3359.5M/s Speed.GPU.#24.: 1943.4M/s Speed.GPU.#25.: 1958.8M/s Speed.GPU.#*.: 63040.9M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: SHA-1(Base64), nsldap, Netscape LDAP SHA Speed.GPU.#1.: 3372.7M/s Speed.GPU.#2.: 3367.0M/s Speed.GPU.#3.: 1946.9M/s Speed.GPU.#4.: 3370.7M/s Speed.GPU.#5.: 1941.9M/s Speed.GPU.#6.: 3368.0M/s Speed.GPU.#7.: 1946.7M/s Speed.GPU.#8.: 3367.7M/s Speed.GPU.#9.: 1947.2M/s Speed.GPU.#10.: 1957.1M/s Speed.GPU.#11.: 3368.9M/s Speed.GPU.#12.: 2064.0M/s Speed.GPU.#13.: 1956.6M/s Speed.GPU.#14.: 3368.7M/s Speed.GPU.#15.: 1943.3M/s Speed.GPU.#16.: 1958.3M/s Speed.GPU.#17.: 3363.9M/s Speed.GPU.#18.: 1943.1M/s Speed.GPU.#19.: 1957.5M/s Speed.GPU.#20.: 3363.9M/s Speed.GPU.#21.: 1943.6M/s Speed.GPU.#22.: 1958.2M/s Speed.GPU.#23.: 3360.3M/s Speed.GPU.#24.: 1944.4M/s Speed.GPU.#25.: 1958.5M/s Speed.GPU.#*.: 63039.2M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: sha1($pass.$salt) Speed.GPU.#1.: 3372.4M/s Speed.GPU.#2.: 3366.7M/s Speed.GPU.#3.: 1945.5M/s Speed.GPU.#4.: 3365.3M/s Speed.GPU.#5.: 1945.7M/s Speed.GPU.#6.: 3365.7M/s Speed.GPU.#7.: 1946.3M/s Speed.GPU.#8.: 3370.3M/s Speed.GPU.#9.: 1947.1M/s Speed.GPU.#10.: 1958.4M/s Speed.GPU.#11.: 3370.9M/s Speed.GPU.#12.: 2063.1M/s Speed.GPU.#13.: 1958.0M/s Speed.GPU.#14.: 3366.2M/s Speed.GPU.#15.: 1943.8M/s Speed.GPU.#16.: 1958.8M/s Speed.GPU.#17.: 3367.3M/s Speed.GPU.#18.: 1944.7M/s Speed.GPU.#19.: 1958.6M/s Speed.GPU.#20.: 3366.3M/s Speed.GPU.#21.: 1942.1M/s Speed.GPU.#22.: 1958.9M/s Speed.GPU.#23.: 3362.6M/s Speed.GPU.#24.: 1944.7M/s Speed.GPU.#25.: 1959.5M/s Speed.GPU.#*.: 63048.9M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: SSHA-1(Base64), nsldaps, Netscape LDAP SSHA Speed.GPU.#1.: 3374.1M/s Speed.GPU.#2.: 3373.0M/s Speed.GPU.#3.: 1944.7M/s Speed.GPU.#4.: 3372.0M/s Speed.GPU.#5.: 1945.1M/s Speed.GPU.#6.: 3372.6M/s Speed.GPU.#7.: 1946.0M/s Speed.GPU.#8.: 3368.3M/s Speed.GPU.#9.: 1946.0M/s Speed.GPU.#10.: 1956.4M/s Speed.GPU.#11.: 3369.1M/s Speed.GPU.#12.: 2063.9M/s Speed.GPU.#13.: 1957.8M/s Speed.GPU.#14.: 3370.6M/s Speed.GPU.#15.: 1945.1M/s Speed.GPU.#16.: 1957.3M/s Speed.GPU.#17.: 3363.3M/s Speed.GPU.#18.: 1944.9M/s Speed.GPU.#19.: 1958.6M/s Speed.GPU.#20.: 3362.8M/s Speed.GPU.#21.: 1944.3M/s Speed.GPU.#22.: 1958.1M/s Speed.GPU.#23.: 3360.9M/s Speed.GPU.#24.: 1945.0M/s Speed.GPU.#25.: 1958.6M/s Speed.GPU.#*.: 63058.6M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: Oracle 11g Speed.GPU.#1.: 3367.7M/s Speed.GPU.#2.: 3370.3M/s Speed.GPU.#3.: 1945.8M/s Speed.GPU.#4.: 3369.2M/s Speed.GPU.#5.: 1947.2M/s Speed.GPU.#6.: 3371.7M/s Speed.GPU.#7.: 1947.3M/s Speed.GPU.#8.: 3368.5M/s Speed.GPU.#9.: 1946.9M/s Speed.GPU.#10.: 1957.6M/s Speed.GPU.#11.: 3373.0M/s Speed.GPU.#12.: 2062.1M/s Speed.GPU.#13.: 1957.7M/s Speed.GPU.#14.: 3373.5M/s Speed.GPU.#15.: 1946.4M/s Speed.GPU.#16.: 1957.1M/s Speed.GPU.#17.: 3367.2M/s Speed.GPU.#18.: 1947.0M/s Speed.GPU.#19.: 1958.4M/s Speed.GPU.#20.: 3368.3M/s Speed.GPU.#21.: 1946.5M/s Speed.GPU.#22.: 1957.8M/s Speed.GPU.#23.: 3361.7M/s Speed.GPU.#24.: 1946.3M/s Speed.GPU.#25.: 1958.4M/s Speed.GPU.#*.: 63073.6M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: MSSQL(2000) Speed.GPU.#1.: 3342.6M/s Speed.GPU.#2.: 3342.2M/s Speed.GPU.#3.: 1938.5M/s Speed.GPU.#4.: 3341.3M/s Speed.GPU.#5.: 1938.5M/s Speed.GPU.#6.: 3349.6M/s Speed.GPU.#7.: 1938.5M/s Speed.GPU.#8.: 3344.9M/s Speed.GPU.#9.: 1938.1M/s Speed.GPU.#10.: 1936.1M/s Speed.GPU.#11.: 3345.0M/s Speed.GPU.#12.: 2052.8M/s Speed.GPU.#13.: 1935.9M/s Speed.GPU.#14.: 3346.8M/s Speed.GPU.#15.: 1937.7M/s Speed.GPU.#16.: 1935.8M/s Speed.GPU.#17.: 3340.7M/s Speed.GPU.#18.: 1937.3M/s Speed.GPU.#19.: 1934.6M/s Speed.GPU.#20.: 3340.4M/s Speed.GPU.#21.: 1937.7M/s Speed.GPU.#22.: 1935.7M/s Speed.GPU.#23.: 3334.8M/s Speed.GPU.#24.: 1938.1M/s Speed.GPU.#25.: 1929.6M/s Speed.GPU.#*.: 62593.1M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: MSSQL(2005) Speed.GPU.#1.: 3355.3M/s Speed.GPU.#2.: 3355.0M/s Speed.GPU.#3.: 1941.9M/s Speed.GPU.#4.: 3355.3M/s Speed.GPU.#5.: 1940.6M/s Speed.GPU.#6.: 3352.7M/s Speed.GPU.#7.: 1940.7M/s Speed.GPU.#8.: 3351.5M/s Speed.GPU.#9.: 1940.9M/s Speed.GPU.#10.: 1937.2M/s Speed.GPU.#11.: 3356.9M/s Speed.GPU.#12.: 2056.8M/s Speed.GPU.#13.: 1940.0M/s Speed.GPU.#14.: 3356.9M/s Speed.GPU.#15.: 1940.8M/s Speed.GPU.#16.: 1925.6M/s Speed.GPU.#17.: 3345.0M/s Speed.GPU.#18.: 1939.7M/s Speed.GPU.#19.: 1937.9M/s Speed.GPU.#20.: 3348.9M/s Speed.GPU.#21.: 1940.9M/s Speed.GPU.#22.: 1937.4M/s Speed.GPU.#23.: 3348.4M/s Speed.GPU.#24.: 1939.8M/s Speed.GPU.#25.: 1939.0M/s Speed.GPU.#*.: 62725.0M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: MySQL Speed.GPU.#1.: 1494.6M/s Speed.GPU.#2.: 1493.9M/s Speed.GPU.#3.: 479.8M/s Speed.GPU.#4.: 1494.3M/s Speed.GPU.#5.: 480.4M/s Speed.GPU.#6.: 1494.1M/s Speed.GPU.#7.: 479.6M/s Speed.GPU.#8.: 1494.3M/s Speed.GPU.#9.: 479.4M/s Speed.GPU.#10.: 687.0M/s Speed.GPU.#11.: 1494.3M/s Speed.GPU.#12.: 499.6M/s Speed.GPU.#13.: 686.1M/s Speed.GPU.#14.: 1494.6M/s Speed.GPU.#15.: 479.8M/s Speed.GPU.#16.: 683.5M/s Speed.GPU.#17.: 1494.3M/s Speed.GPU.#18.: 479.8M/s Speed.GPU.#19.: 680.8M/s Speed.GPU.#20.: 1494.6M/s Speed.GPU.#21.: 479.6M/s Speed.GPU.#22.: 685.3M/s Speed.GPU.#23.: 1494.1M/s Speed.GPU.#24.: 480.0M/s Speed.GPU.#25.: 679.5M/s Speed.GPU.#*.: 23383.1M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: MD4 Speed.GPU.#1.: 18927.0M/s Speed.GPU.#2.: 19012.1M/s Speed.GPU.#3.: 9781.0M/s Speed.GPU.#4.: 18915.8M/s Speed.GPU.#5.: 9806.7M/s Speed.GPU.#6.: 19040.1M/s Speed.GPU.#7.: 9804.1M/s Speed.GPU.#8.: 18946.8M/s Speed.GPU.#9.: 9843.0M/s Speed.GPU.#10.: 10781.7M/s Speed.GPU.#11.: 19035.9M/s Speed.GPU.#12.: 10437.0M/s Speed.GPU.#13.: 10752.4M/s Speed.GPU.#14.: 18985.0M/s Speed.GPU.#15.: 9751.1M/s Speed.GPU.#16.: 10805.2M/s Speed.GPU.#17.: 18457.9M/s Speed.GPU.#18.: 9750.0M/s Speed.GPU.#19.: 10778.2M/s Speed.GPU.#20.: 18511.4M/s Speed.GPU.#21.: 9745.9M/s Speed.GPU.#22.: 10794.6M/s Speed.GPU.#23.: 18429.4M/s Speed.GPU.#24.: 9740.8M/s Speed.GPU.#25.: 10789.9M/s Speed.GPU.#*.: 341.6G/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: md4($pass.$salt) Speed.GPU.#1.: 18937.3M/s Speed.GPU.#2.: 19001.0M/s Speed.GPU.#3.: 9879.9M/s Speed.GPU.#4.: 19052.1M/s Speed.GPU.#5.: 9877.9M/s Speed.GPU.#6.: 19005.9M/s Speed.GPU.#7.: 9886.7M/s Speed.GPU.#8.: 18977.5M/s Speed.GPU.#9.: 9894.7M/s Speed.GPU.#10.: 10790.3M/s Speed.GPU.#11.: 18950.9M/s Speed.GPU.#12.: 10458.1M/s Speed.GPU.#13.: 10802.6M/s Speed.GPU.#14.: 18998.3M/s Speed.GPU.#15.: 9840.5M/s Speed.GPU.#16.: 10752.8M/s Speed.GPU.#17.: 18497.2M/s Speed.GPU.#18.: 9770.8M/s Speed.GPU.#19.: 10765.3M/s Speed.GPU.#20.: 18603.5M/s Speed.GPU.#21.: 9726.1M/s Speed.GPU.#22.: 10821.4M/s Speed.GPU.#23.: 18472.9M/s Speed.GPU.#24.: 9837.7M/s Speed.GPU.#25.: 10745.3M/s Speed.GPU.#*.: 342.3G/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: NTLM Speed.GPU.#1.: 18334.2M/s Speed.GPU.#2.: 18280.8M/s Speed.GPU.#3.: 9649.7M/s Speed.GPU.#4.: 18345.4M/s Speed.GPU.#5.: 9650.9M/s Speed.GPU.#6.: 18251.7M/s Speed.GPU.#7.: 9664.1M/s Speed.GPU.#8.: 18354.1M/s Speed.GPU.#9.: 9676.0M/s Speed.GPU.#10.: 10612.2M/s Speed.GPU.#11.: 18253.6M/s Speed.GPU.#12.: 10229.6M/s Speed.GPU.#13.: 10649.0M/s Speed.GPU.#14.: 18290.7M/s Speed.GPU.#15.: 9608.7M/s Speed.GPU.#16.: 10645.5M/s Speed.GPU.#17.: 17930.6M/s Speed.GPU.#18.: 9643.8M/s Speed.GPU.#19.: 10665.0M/s Speed.GPU.#20.: 17918.7M/s Speed.GPU.#21.: 9616.0M/s Speed.GPU.#22.: 10639.6M/s Speed.GPU.#23.: 17877.9M/s Speed.GPU.#24.: 9585.4M/s Speed.GPU.#25.: 10617.4M/s Speed.GPU.#*.: 333.0G/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: DCC, mscash Speed.GPU.#1.: 5041.6M/s Speed.GPU.#2.: 5047.1M/s Speed.GPU.#3.: 2919.9M/s Speed.GPU.#4.: 5047.4M/s Speed.GPU.#5.: 2920.2M/s Speed.GPU.#6.: 5047.3M/s Speed.GPU.#7.: 2919.3M/s Speed.GPU.#8.: 5048.3M/s Speed.GPU.#9.: 2919.3M/s Speed.GPU.#10.: 3009.3M/s Speed.GPU.#11.: 5054.4M/s Speed.GPU.#12.: 3091.9M/s Speed.GPU.#13.: 3011.1M/s Speed.GPU.#14.: 5050.8M/s Speed.GPU.#15.: 2910.7M/s Speed.GPU.#16.: 3009.6M/s Speed.GPU.#17.: 5018.7M/s Speed.GPU.#18.: 2911.2M/s Speed.GPU.#19.: 3009.0M/s Speed.GPU.#20.: 5019.1M/s Speed.GPU.#21.: 2910.0M/s Speed.GPU.#22.: 3008.9M/s Speed.GPU.#23.: 5012.4M/s Speed.GPU.#24.: 2911.5M/s Speed.GPU.#25.: 3007.5M/s Speed.GPU.#*.: 94856.3M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: SHA256 Speed.GPU.#1.: 1206.8M/s Speed.GPU.#2.: 1210.3M/s Speed.GPU.#3.: 589.6M/s Speed.GPU.#4.: 1208.2M/s Speed.GPU.#5.: 586.6M/s Speed.GPU.#6.: 1216.7M/s Speed.GPU.#7.: 588.2M/s Speed.GPU.#8.: 1209.0M/s Speed.GPU.#9.: 587.8M/s Speed.GPU.#10.: 684.6M/s Speed.GPU.#11.: 1214.9M/s Speed.GPU.#12.: 620.7M/s Speed.GPU.#13.: 694.0M/s Speed.GPU.#14.: 1215.9M/s Speed.GPU.#15.: 584.8M/s Speed.GPU.#16.: 701.1M/s Speed.GPU.#17.: 1160.8M/s Speed.GPU.#18.: 577.1M/s Speed.GPU.#19.: 703.0M/s Speed.GPU.#20.: 1161.6M/s Speed.GPU.#21.: 578.8M/s Speed.GPU.#22.: 698.7M/s Speed.GPU.#23.: 1166.6M/s Speed.GPU.#24.: 578.1M/s Speed.GPU.#25.: 694.2M/s Speed.GPU.#*.: 21438.4M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: sha256($pass.$salt) Speed.GPU.#1.: 1210.9M/s Speed.GPU.#2.: 1206.0M/s Speed.GPU.#3.: 586.9M/s Speed.GPU.#4.: 1211.0M/s Speed.GPU.#5.: 584.0M/s Speed.GPU.#6.: 1217.9M/s Speed.GPU.#7.: 586.5M/s Speed.GPU.#8.: 1200.7M/s Speed.GPU.#9.: 585.8M/s Speed.GPU.#10.: 700.3M/s Speed.GPU.#11.: 1211.7M/s Speed.GPU.#12.: 618.9M/s Speed.GPU.#13.: 699.4M/s Speed.GPU.#14.: 1218.7M/s Speed.GPU.#15.: 581.0M/s Speed.GPU.#16.: 698.9M/s Speed.GPU.#17.: 1157.0M/s Speed.GPU.#18.: 579.7M/s Speed.GPU.#19.: 701.3M/s Speed.GPU.#20.: 1159.3M/s Speed.GPU.#21.: 583.4M/s Speed.GPU.#22.: 696.8M/s Speed.GPU.#23.: 1153.9M/s Speed.GPU.#24.: 579.7M/s Speed.GPU.#25.: 695.0M/s Speed.GPU.#*.: 21424.6M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: descrypt, DES(Unix), Traditional DES Speed.GPU.#1.: 96840.6k/s Speed.GPU.#2.: 96781.8k/s Speed.GPU.#3.: 32583.9k/s Speed.GPU.#4.: 96765.3k/s Speed.GPU.#5.: 32599.2k/s Speed.GPU.#6.: 96822.2k/s Speed.GPU.#7.: 32593.9k/s Speed.GPU.#8.: 96780.3k/s Speed.GPU.#9.: 32598.7k/s Speed.GPU.#10.: 42166.8k/s Speed.GPU.#11.: 96801.4k/s Speed.GPU.#12.: 34560.1k/s Speed.GPU.#13.: 42175.5k/s Speed.GPU.#14.: 96934.1k/s Speed.GPU.#15.: 32575.1k/s Speed.GPU.#16.: 42182.0k/s Speed.GPU.#17.: 96834.8k/s Speed.GPU.#18.: 32580.1k/s Speed.GPU.#19.: 42191.9k/s Speed.GPU.#20.: 96833.9k/s Speed.GPU.#21.: 32587.6k/s Speed.GPU.#22.: 42191.3k/s Speed.GPU.#23.: 96848.8k/s Speed.GPU.#24.: 32574.9k/s Speed.GPU.#25.: 42209.0k/s Speed.GPU.#*.: 1516.6M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: SHA512 Speed.GPU.#1.: 97034.7k/s Speed.GPU.#2.: 96979.7k/s Speed.GPU.#3.: 56830.4k/s Speed.GPU.#4.: 96955.2k/s Speed.GPU.#5.: 56894.6k/s Speed.GPU.#6.: 97054.2k/s Speed.GPU.#7.: 56797.0k/s Speed.GPU.#8.: 97039.9k/s Speed.GPU.#9.: 57711.3k/s Speed.GPU.#10.: 113.8M/s Speed.GPU.#11.: 97038.2k/s Speed.GPU.#12.: 60066.2k/s Speed.GPU.#13.: 117.3M/s Speed.GPU.#14.: 97059.2k/s Speed.GPU.#15.: 57559.4k/s Speed.GPU.#16.: 117.3M/s Speed.GPU.#17.: 96984.8k/s Speed.GPU.#18.: 57609.8k/s Speed.GPU.#19.: 117.2M/s Speed.GPU.#20.: 96997.7k/s Speed.GPU.#21.: 57631.1k/s Speed.GPU.#22.: 117.2M/s Speed.GPU.#23.: 96982.7k/s Speed.GPU.#24.: 57648.4k/s Speed.GPU.#25.: 117.3M/s Speed.GPU.#*.: 2188.9M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: sha512($pass.$salt) Speed.GPU.#1.: 97045.2k/s Speed.GPU.#2.: 97000.0k/s Speed.GPU.#3.: 57696.1k/s Speed.GPU.#4.: 97048.7k/s Speed.GPU.#5.: 57693.7k/s Speed.GPU.#6.: 97051.5k/s Speed.GPU.#7.: 57607.4k/s Speed.GPU.#8.: 97037.1k/s Speed.GPU.#9.: 57725.1k/s Speed.GPU.#10.: 117.2M/s Speed.GPU.#11.: 97138.5k/s Speed.GPU.#12.: 60111.0k/s Speed.GPU.#13.: 117.3M/s Speed.GPU.#14.: 97027.4k/s Speed.GPU.#15.: 57580.1k/s Speed.GPU.#16.: 117.3M/s Speed.GPU.#17.: 97030.9k/s Speed.GPU.#18.: 57716.0k/s Speed.GPU.#19.: 117.3M/s Speed.GPU.#20.: 97031.4k/s Speed.GPU.#21.: 57595.1k/s Speed.GPU.#22.: 117.4M/s Speed.GPU.#23.: 96970.8k/s Speed.GPU.#24.: 57766.2k/s Speed.GPU.#25.: 117.3M/s Speed.GPU.#*.: 2195.6M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: SL3 Speed.GPU.#1.: 3353.4M/s Speed.GPU.#2.: 3354.1M/s Speed.GPU.#3.: 1943.8M/s Speed.GPU.#4.: 3354.4M/s Speed.GPU.#5.: 1944.2M/s Speed.GPU.#6.: 3356.1M/s Speed.GPU.#7.: 1944.3M/s Speed.GPU.#8.: 3356.9M/s Speed.GPU.#9.: 1944.1M/s Speed.GPU.#10.: 1939.5M/s Speed.GPU.#11.: 3352.5M/s Speed.GPU.#12.: 2059.7M/s Speed.GPU.#13.: 1928.2M/s Speed.GPU.#14.: 3353.6M/s Speed.GPU.#15.: 1941.7M/s Speed.GPU.#16.: 1938.7M/s Speed.GPU.#17.: 3346.8M/s Speed.GPU.#18.: 1942.3M/s Speed.GPU.#19.: 1932.1M/s Speed.GPU.#20.: 3345.4M/s Speed.GPU.#21.: 1941.8M/s Speed.GPU.#22.: 1939.4M/s Speed.GPU.#23.: 3345.4M/s Speed.GPU.#24.: 1941.7M/s Speed.GPU.#25.: 1941.1M/s Speed.GPU.#*.: 62741.2M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: Cisco-PIX MD5 Speed.GPU.#1.: 6436.9M/s Speed.GPU.#2.: 6430.8M/s Speed.GPU.#3.: 3749.9M/s Speed.GPU.#4.: 6418.6M/s Speed.GPU.#5.: 3750.2M/s Speed.GPU.#6.: 6423.8M/s Speed.GPU.#7.: 3752.0M/s Speed.GPU.#8.: 6418.6M/s Speed.GPU.#9.: 3752.0M/s Speed.GPU.#10.: 3810.0M/s Speed.GPU.#11.: 6426.8M/s Speed.GPU.#12.: 3970.2M/s Speed.GPU.#13.: 3815.4M/s Speed.GPU.#14.: 6420.0M/s Speed.GPU.#15.: 3742.5M/s Speed.GPU.#16.: 3813.8M/s Speed.GPU.#17.: 6388.6M/s Speed.GPU.#18.: 3743.2M/s Speed.GPU.#19.: 3813.8M/s Speed.GPU.#20.: 6392.9M/s Speed.GPU.#21.: 3742.6M/s Speed.GPU.#22.: 3813.5M/s Speed.GPU.#23.: 6387.9M/s Speed.GPU.#24.: 3726.5M/s Speed.GPU.#25.: 3815.1M/s Speed.GPU.#*.: 121.0G/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: Double MD5 Speed.GPU.#1.: 2741.1M/s Speed.GPU.#2.: 2741.6M/s Speed.GPU.#3.: 1365.8M/s Speed.GPU.#4.: 2747.1M/s Speed.GPU.#5.: 1366.1M/s Speed.GPU.#6.: 2744.9M/s Speed.GPU.#7.: 1366.0M/s Speed.GPU.#8.: 2744.1M/s Speed.GPU.#9.: 1366.0M/s Speed.GPU.#10.: 1552.0M/s Speed.GPU.#11.: 2743.7M/s Speed.GPU.#12.: 1432.4M/s Speed.GPU.#13.: 1552.4M/s Speed.GPU.#14.: 2744.3M/s Speed.GPU.#15.: 1364.9M/s Speed.GPU.#16.: 1551.8M/s Speed.GPU.#17.: 2744.1M/s Speed.GPU.#18.: 1365.3M/s Speed.GPU.#19.: 1552.1M/s Speed.GPU.#20.: 2743.7M/s Speed.GPU.#21.: 1365.3M/s Speed.GPU.#22.: 1552.9M/s Speed.GPU.#23.: 2744.7M/s Speed.GPU.#24.: 1365.7M/s Speed.GPU.#25.: 1551.8M/s Speed.GPU.#*.: 49109.8M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: vBulletin < v3.8.5 Speed.GPU.#1.: 2746.9M/s Speed.GPU.#2.: 2744.6M/s Speed.GPU.#3.: 1365.7M/s Speed.GPU.#4.: 2746.1M/s Speed.GPU.#5.: 1365.7M/s Speed.GPU.#6.: 2747.8M/s Speed.GPU.#7.: 1366.2M/s Speed.GPU.#8.: 2746.0M/s Speed.GPU.#9.: 1365.8M/s Speed.GPU.#10.: 1552.6M/s Speed.GPU.#11.: 2746.6M/s Speed.GPU.#12.: 1432.7M/s Speed.GPU.#13.: 1553.1M/s Speed.GPU.#14.: 2747.8M/s Speed.GPU.#15.: 1365.0M/s Speed.GPU.#16.: 1552.3M/s Speed.GPU.#17.: 2743.7M/s Speed.GPU.#18.: 1365.5M/s Speed.GPU.#19.: 1553.1M/s Speed.GPU.#20.: 2744.6M/s Speed.GPU.#21.: 1366.0M/s Speed.GPU.#22.: 1553.6M/s Speed.GPU.#23.: 2740.7M/s Speed.GPU.#24.: 1365.6M/s Speed.GPU.#25.: 1553.2M/s Speed.GPU.#*.: 49131.1M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: vBulletin > v3.8.5 Speed.GPU.#1.: 1874.8M/s Speed.GPU.#2.: 1874.4M/s Speed.GPU.#3.: 1046.8M/s Speed.GPU.#4.: 1874.7M/s Speed.GPU.#5.: 1046.4M/s Speed.GPU.#6.: 1875.6M/s Speed.GPU.#7.: 1046.2M/s Speed.GPU.#8.: 1875.9M/s Speed.GPU.#9.: 1046.4M/s Speed.GPU.#10.: 1082.5M/s Speed.GPU.#11.: 1875.0M/s Speed.GPU.#12.: 1108.7M/s Speed.GPU.#13.: 1082.9M/s Speed.GPU.#14.: 1875.9M/s Speed.GPU.#15.: 1046.1M/s Speed.GPU.#16.: 1083.0M/s Speed.GPU.#17.: 1875.2M/s Speed.GPU.#18.: 1045.9M/s Speed.GPU.#19.: 1083.3M/s Speed.GPU.#20.: 1875.4M/s Speed.GPU.#21.: 1046.3M/s Speed.GPU.#22.: 1084.8M/s Speed.GPU.#23.: 1875.7M/s Speed.GPU.#24.: 1045.1M/s Speed.GPU.#25.: 1084.3M/s Speed.GPU.#*.: 34731.1M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: IPB2+, MyBB1.2+ Speed.GPU.#1.: 1919.0M/s Speed.GPU.#2.: 1918.5M/s Speed.GPU.#3.: 1091.4M/s Speed.GPU.#4.: 1918.2M/s Speed.GPU.#5.: 1092.0M/s Speed.GPU.#6.: 1919.4M/s Speed.GPU.#7.: 1091.5M/s Speed.GPU.#8.: 1918.9M/s Speed.GPU.#9.: 1091.6M/s Speed.GPU.#10.: 1124.6M/s Speed.GPU.#11.: 1920.2M/s Speed.GPU.#12.: 1157.3M/s Speed.GPU.#13.: 1124.8M/s Speed.GPU.#14.: 1921.2M/s Speed.GPU.#15.: 1091.5M/s Speed.GPU.#16.: 1124.5M/s Speed.GPU.#17.: 1920.1M/s Speed.GPU.#18.: 1091.9M/s Speed.GPU.#19.: 1124.7M/s Speed.GPU.#20.: 1919.6M/s Speed.GPU.#21.: 1092.3M/s Speed.GPU.#22.: 1125.2M/s Speed.GPU.#23.: 1918.5M/s Speed.GPU.#24.: 1092.3M/s Speed.GPU.#25.: 1125.1M/s Speed.GPU.#*.: 35834.3M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: LM Speed.GPU.#1.: 1441.2M/s Speed.GPU.#2.: 1441.7M/s Speed.GPU.#3.: 313.5M/s Speed.GPU.#4.: 1443.3M/s Speed.GPU.#5.: 313.8M/s Speed.GPU.#6.: 1443.7M/s Speed.GPU.#7.: 313.3M/s Speed.GPU.#8.: 1442.9M/s Speed.GPU.#9.: 313.5M/s Speed.GPU.#10.: 523.9M/s Speed.GPU.#11.: 1442.7M/s Speed.GPU.#12.: 327.2M/s Speed.GPU.#13.: 523.9M/s Speed.GPU.#14.: 1443.5M/s Speed.GPU.#15.: 311.5M/s Speed.GPU.#16.: 523.9M/s Speed.GPU.#17.: 1442.9M/s Speed.GPU.#18.: 312.8M/s Speed.GPU.#19.: 524.0M/s Speed.GPU.#20.: 1443.0M/s Speed.GPU.#21.: 312.3M/s Speed.GPU.#22.: 524.1M/s Speed.GPU.#23.: 1442.6M/s Speed.GPU.#24.: 313.2M/s Speed.GPU.#25.: 524.2M/s Speed.GPU.#*.: 20402.7M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: Oracle 7-10g Speed.GPU.#1.: 170.2M/s Speed.GPU.#2.: 170.0M/s Speed.GPU.#3.: 97575.9k/s Speed.GPU.#4.: 170.1M/s Speed.GPU.#5.: 97579.6k/s Speed.GPU.#6.: 170.1M/s Speed.GPU.#7.: 97658.2k/s Speed.GPU.#8.: 170.2M/s Speed.GPU.#9.: 97625.6k/s Speed.GPU.#10.: 127.9M/s Speed.GPU.#11.: 170.2M/s Speed.GPU.#12.: 102.6M/s Speed.GPU.#13.: 127.7M/s Speed.GPU.#14.: 170.1M/s Speed.GPU.#15.: 97210.5k/s Speed.GPU.#16.: 128.1M/s Speed.GPU.#17.: 168.5M/s Speed.GPU.#18.: 97159.6k/s Speed.GPU.#19.: 128.0M/s Speed.GPU.#20.: 168.3M/s Speed.GPU.#21.: 97203.8k/s Speed.GPU.#22.: 127.9M/s Speed.GPU.#23.: 168.4M/s Speed.GPU.#24.: 97197.0k/s Speed.GPU.#25.: 127.7M/s Speed.GPU.#*.: 3345.1M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... Hash.Type....: SHA-3(Keccak) Speed.GPU.#1.: 85409.7k/s Speed.GPU.#2.: 85416.8k/s Speed.GPU.#3.: 73100.9k/s Speed.GPU.#4.: 85462.5k/s Speed.GPU.#5.: 73377.3k/s Speed.GPU.#6.: 85361.0k/s Speed.GPU.#7.: 72864.6k/s Speed.GPU.#8.: 85437.6k/s Speed.GPU.#9.: 73022.8k/s Speed.GPU.#10.: 105.8M/s Speed.GPU.#11.: 85460.7k/s Speed.GPU.#12.: 77392.4k/s Speed.GPU.#13.: 105.7M/s Speed.GPU.#14.: 85456.5k/s Speed.GPU.#15.: 72965.9k/s Speed.GPU.#16.: 105.8M/s Speed.GPU.#17.: 85408.4k/s Speed.GPU.#18.: 72946.1k/s Speed.GPU.#19.: 105.7M/s Speed.GPU.#20.: 85424.0k/s Speed.GPU.#21.: 73184.1k/s Speed.GPU.#22.: 105.8M/s Speed.GPU.#23.: 85350.3k/s Speed.GPU.#24.: 73033.3k/s Speed.GPU.#25.: 105.8M/s Speed.GPU.#*.: 2150.7M/s [s]tatus [p]ause [r]esume [q]uit => NOTE: Runtime limit reached, aborting... dd Started: Thu Nov 29 19:45:08 2012 Stopped: Thu Nov 29 19:57:36 2012

What a very interesting post. I can see from various form posts that some have attempted the following with little success. Before I attempt this revelation can you elobarate on the configuration details; and provide and estimate on the total network configuration (No GPU system pricing required)

What brand/model of Infinibad HBA adapter is used within each system?(X4 SDR interconnect)
What brand/model of Infinibad switch did you acquire?
What type of cabling is used from each adapter to the switch?(Fibre or cx-4 attached copper)
What version of Linux/Ubuntu did you test with?(12.04 or 12.04.1x64) Was ther native supprot for adapter drivers?
Was there any draw-baks interms of speeds based on the infiband x4 SDR technology that you used vs. x4ddr/x4qdr?

Thanx

(12-03-2012, 10:14 PM)jnet Wrote: Very impressive numbers! So vclhashcat-lite v0.11 will support mixed-GPUs.

Any idea when this will be released for the public?

current version of lite already supports mixed gpus. next version of plus supports mixed gpus, and should be released this month.

(12-03-2012, 11:35 PM)tatgdi Wrote: What brand/model of Infinibad HBA adapter is used within each system?(X4 SDR interconnect)
What brand/model of Infinibad switch did you acquire?
What type of cabling is used from each adapter to the switch?(Fibre or cx-4 attached copper)
What version of Linux/Ubuntu did you test with?(12.04 or 12.04.1x64) Was ther native supprot for adapter drivers?
Was there any draw-baks interms of speeds based on the infiband x4 SDR technology that you used vs. x4ddr/x4qdr?

I'm using old Mellanox MHEA28-XT HCAs and a Cisco SFS7000P / Topspin 120 switch. But it doesn't really matter what you get, the open drivers will support any Infiniband hardware from what I understand. This specific setup uses all copper/CX4 cabling.

All nodes are running amd64 Ubuntu 12.04 LTS. Everything works out of the box after loading the right modules and bringing up ib0.

4x SDR is plenty of bandwidth for what I have. I'm actually not breaking 1 Gbps at the moment. But Infiniband mitigates latency.