Task #53467

Epic #55070: Workpackages

Epic #55065: WP: Overall System Performance (Backend and Frontend)

Bug #52949: Speed decrease since 4.5

Improve flush by tag performance for the file cache backend

Added by Tymoteusz Motylewski over 1 year ago. Updated 5 months ago.

Status:Under Review Start date:2013-11-08
Priority:Should have Due date:
Assigned To:Tymoteusz Motylewski % Done:

0%
Category:Performance Spent time: -
Target version:-
TYPO3 Version:6.2 Complexity:
PHP Version: Sprint Focus:

Description

currently the "flush by tag" command is painfully slow when using file cache backend.
This can be improved e.g. by using tag index (one file for each tag, containing id's of the cache entries)

History

#1 Updated by Gerrit Code Review over 1 year ago

  • Status changed from New to Under Review

Patch set 1 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#2 Updated by Gerrit Code Review over 1 year ago

Patch set 2 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#3 Updated by Tymoteusz Motylewski over 1 year ago

you can test the performance of this file cache backend by using my tool
https://github.com/macopedia/cache_benchmark

For Patchset 2

Flushing is over 100times faster, but unfortunatelly write is 2x slower.

-----
Benchmarking 4 concurrent clients, each with 50000 operations...
4 concurrent clients completed in 3 seconds

|   reads|  writes|  cleans
------------------------------------
Client  1|21369.76|  556.49| 1017.37
Client  2|21277.23| 1833.75|  278.43
Client  0|21314.86| 1797.12|  120.11
Client  3|22417.16| 1368.34|  110.95
------------------------------------
ops/sec  |86379.01| 5555.70| 1526.86

Old file cache backend:

Benchmarking 4 concurrent clients, each with 50000 operations...
4 concurrent clients completed in 26 seconds

|   reads|  writes|  cleans
------------------------------------
Client  3|21489.71| 2898.47|    2.75
Client  1|20706.24| 3049.82|    2.74
Client  2|21282.95| 2693.66|    3.31
Client  0|20981.27| 2851.33|    2.59
------------------------------------
ops/sec  |84460.17|11493.28|   11.39

#4 Updated by Gerrit Code Review over 1 year ago

Patch set 3 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#5 Updated by Gerrit Code Review over 1 year ago

Patch set 4 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#6 Updated by Gerrit Code Review over 1 year ago

Patch set 5 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#7 Updated by Tymoteusz Motylewski over 1 year ago

results for the patchset 5:

Old file cache backend

ops/sec |88916.18|11260.14| 8.22

New file cache backend (patchset 5)

ops/sec |92454.31| 6830.13| 2212.49

#8 Updated by Gerrit Code Review over 1 year ago

Patch set 6 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#9 Updated by Gerrit Code Review over 1 year ago

Patch set 7 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at https://review.typo3.org/25226

#10 Updated by Ernesto Baschny over 1 year ago

  • Parent task set to #52949

#11 Updated by Andreas Wolf over 1 year ago

Is this issue still relevant despite the performance issues?

#12 Updated by Gerrit Code Review 5 months ago

Patch set 8 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/25226

Also available in: Atom PDF