Transaction selection policy in tier-to-tier SBSRS by using deep q-learning

dc.contributor.authorArslan, Bartu
dc.contributor.authorYetkin Ekren, Banu
dc.date.accessioned2022-12-15T10:49:23Z
dc.date.available2022-12-15T10:49:23Z
dc.date.issued2022-11-30
dc.description.abstractThis paper studies a Deep Q-Learning (DQL) method for transaction sequencing problems in an automated warehousing system, Shuttle-based Storage and Retrieval System (SBSRS), in which shuttles can move between tiers flexibly. Here, the system is referred to as tier-to-tier SBSRS (t-SBSRS), developed as an alternative design to tier-captive SBSRS (c-SBSRS). By the flexible travel of shuttles between tiers in t-SBSRS, the number of shuttles in the system may be reduced compared to its simulant c-SBSRS design. The flexible travel of shuttles makes the operation decisions more complex in that system, motivating us to explore whether integration of a machine learning approach would help to improve the system performance. We apply the DQL method for the transaction selection of shuttles in the system to attain process time advantage. The outcomes of the DQN are confronted with the well-applied heuristic approaches: first-come-first-serve (FIFO) and shortest process time (SPT) rules under different racking and numbers of shuttles scenarios. The results show that DQL outperforms the FIFO and SPT rules promising for the future of smart industry applications. Especially, compared to the well-applied SPT rule in industries, DQL improves the average cycle time per transaction by roughly 43% on average.en_UK
dc.identifier.citationArslan B, Yetkin Ekren B. (2023) Transaction selection policy in tier-to-tier SBSRS by using deep q-learning. International Journal of Production Research, Volume 61, Issue 21, 2023, pp. 7353-7366en_UK
dc.identifier.issn0020-7543
dc.identifier.urihttps://doi.org/10.1080/00207543.2022.2148767
dc.identifier.urihttps://dspace.lib.cranfield.ac.uk/handle/1826/18828
dc.language.isoenen_UK
dc.publisherTaylor and Francisen_UK
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/*
dc.subjectLogisticsen_UK
dc.subjectSBSRSen_UK
dc.subjectAutomated Warehousingen_UK
dc.subjectDeep Reinforcement Learningen_UK
dc.subjectDQNen_UK
dc.subjectAgent-based Simulationen_UK
dc.titleTransaction selection policy in tier-to-tier SBSRS by using deep q-learningen_UK
dc.typeArticleen_UK

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
tier_to_tier_SBSRS_by_using_Deep_Q_Learning-2022.pdf
Size:
3.82 MB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.63 KB
Format:
Item-specific license agreed upon to submission
Description: