PyTorchKR Papers

최신 논문

총 7,781편
태그·기간 등 상세 필터

카테고리 탐색

로그인 후 이 태그 구독

arXiv:2504.02644

Solving the Paint Shop Problem with Flexible Management of Multi-Lane Buffers Using Reinforcement Learning and Action Masking

In the paint shop problem, an unordered incoming sequence of cars assigned to different colors has to be reshuffled with the objective of minimizing the number of color changes. To reshuffle the incoming sequence, manufacturers can employ a first-in-first-out multi-lane buffer system allowing store and retrieve operations. So far, prior studies primarily focused on simple decision heuristics like greedy or simplified problem variants that do not allow full flexibility when performing store and retrieve operations. In this study, we propose a reinforcement learning approach to minimize color changes for the flexible problem variant, where store and retrieve operations can be performed in an arbitrary order. After proving that greedy retrieval is optimal, we incorporate this finding into the model using action masking. Our evaluation, based on 170 problem instances with 2-8 buffer lanes and 5-15 colors, shows that our approach reduces color changes compared to existing methods by considerable margins depending on the problem size. Furthermore, we demonstrate the robustness of our approach towards different buffer sizes and imbalanced color distributions.

arXiv:2504.02214

Geospatial Artificial Intelligence for Satellite-Based Flood Extent Mapping: Concepts, Advances, and Future Perspectives

Geospatial Artificial Intelligence (GeoAI) for satellite-based flood extent mapping systematically integrates artificial intelligence techniques with satellite data to identify flood events and assess their impacts, for disaster management and spatial decision-making. The primary output often includes flood extent maps, which delineate the affected areas, along with additional analytical outputs such as uncertainty estimation and change detection.

arXiv:2504.02203공식 코드 · Papers with Code

Modelling \textit{Aedes albopictus} management, incorporating immigration and bi-directional \textit{Wolbachia} interactions

\textit{Aedes albopictus} mosquitoes are competent vectors for the spread of at least 24 different arboviruses, including dengue, Ross River, and Japanese encephalitis viruses. However, they remain less studied than their more urban cousins, \textit{Aedes aegypti}. We model an Incompatible Insect Technique (IIT) strategy for mosquito control, with bi-directional incompatibility between two strains of \textit{Wolbachia} (\walba/\walbb\, $\times$ \arwp) and age-based cytoplasmic incompatibility decay in a well-mixed population. An important consideration in bi-directional IIT control programs is reversibility when immigration is included. We explore the establishment probability after female contamination of an artificially-infected \textit{Wolbachia} mosquito strain, finding a conservative threshold of 40\% likely driven by mating inefficiencies -- this threshold needs validation in future field and lab experiments. We consider the suppression dynamics and probability of mosquito management success for different release strategies, showing differences in success between release cessation and six months later for different immigration rates. Importantly, our model suggests bi-directional IIT control programs are reversible with low amounts of immigration. We determine a corresponding cost proxy (numbers of mosquitoes released), showing similar short-term costs with differences in medium- and longer-term costs between release strategies. This work demonstrates opportunities to optimise the suppression of these medically important mosquitoes.

arXiv:2504.01818공식 코드 · Papers with Code

Efficient Constant-Space Multi-Vector Retrieval

Multi-vector retrieval methods, exemplified by the ColBERT architecture, have shown substantial promise for retrieval by providing strong trade-offs in terms of retrieval latency and effectiveness. However, they come at a high cost in terms of storage since a (potentially compressed) vector needs to be stored for every token in the input collection. To overcome this issue, we propose encoding documents to a fixed number of vectors, which are no longer necessarily tied to the input tokens. Beyond reducing the storage costs, our approach has the advantage that document representations become of a fixed size on disk, allowing for better OS paging management. Through experiments using the MSMARCO passage corpus and BEIR with the ColBERT-v2 architecture, a representative multi-vector ranking model architecture, we find that passages can be effectively encoded into a fixed number of vectors while retaining most of the original effectiveness.

arXiv:2504.01423

Dynamic Incentive Strategies for Smart EV Charging Stations: An LLM-Driven User Digital Twin Approach

This paper presents an enhanced electric vehicle demand response system based on large language models, aimed at optimizing the application of vehicle-to-grid technology. By leveraging an large language models-driven multi-agent framework to construct user digital twins integrated with multidimensional user profile features, it enables deep simulation and precise prediction of users' charging and discharging decision-making patterns. Additionally, a data- and knowledge-driven dynamic incentive mechanism is proposed, combining a distributed optimization model under network constraints to optimize the grid-user interaction while ensuring both economic viability and security. Simulation results demonstrate that the approach significantly improves load peak-valley regulation and charging/discharging strategies. Experimental validation highlights the system's substantial advantages in load balancing, user satisfaction and grid stability, providing decision-makers with a scalable V2G management tool that promotes the sustainable, synergistic development of vehicle-grid integration.

arXiv:2504.01344

IRS Assisted Decentralized Learning for Wideband Spectrum Sensing

The increasing demand for reliable connectivity in industrial environments necessitates effective spectrum utilization strategies, especially in the context of shared spectrum bands. However, the dynamic spectrum-sharing mechanisms often lead to significant interference and critical failures, creating a trade-off between spectrum scarcity and under-utilization. This paper addresses these challenges by proposing a novel Intelligent Reflecting Surface (IRS)-assisted spectrum sensing framework integrated with decentralized deep learning. The proposed model overcomes partial observation constraints and minimizes communication overhead while leveraging IRS technology to enhance spectrum sensing accuracy. Through comprehensive simulations, the framework demonstrates its ability to monitor wideband spectrum occupancy effectively, even under challenging signal-to-noise ratio (SNR) conditions. This approach offers a scalable and robust solution for spectrum management in next-generation wireless networks.

arXiv:2504.00849

Timely Trajectory Reconstruction in Finite Buffer Remote Tracking Systems

Remote tracking systems play a critical role in applications such as IoT, monitoring, surveillance and healthcare. In such systems, maintaining both real-time state awareness (for online decision making) and accurate reconstruction of historical trajectories (for offline post-processing) are essential. While the Age of Information (AoI) metric has been extensively studied as a measure of freshness, it does not capture the accuracy with which past trajectories can be reconstructed. In this work, we investigate reconstruction error as a complementary metric to AoI, addressing the trade-off between timely updates and historical accuracy. Specifically, we consider three policies, each prioritizing different aspects of information management: Keep-Old, Keep-Fresh, and our proposed Inter-arrival-Aware dropping policy. We compare these policies in terms of impact on both AoI and reconstruction error in a remote tracking system with a finite buffer. Through theoretical analysis and numerical simulations of queueing behavior, we demonstrate that while the Keep-Fresh policy minimizes AoI, it does not necessarily minimize reconstruction error. In contrast, our proposed Inter-arrival-Aware dropping policy dynamically adjusts packet retention decisions based on generation times, achieving a balance between AoI and reconstruction error. Our results provide key insights into the design of efficient buffer management policies for resource-constrained IoT networks.

arXiv:2504.00277

Rack Position Optimization in Large-Scale Heterogeneous Data Centers

As rapidly growing AI computational demands accelerate the need for new hardware installation and maintenance, this work explores optimal data center resource management by balancing operational efficiency with fault tolerance through strategic rack positioning considering diverse resources and locations. Traditional mixed-integer programming (MIP) approaches often struggle with scalability, while heuristic methods may result in significant sub-optimality. To address these issues, this paper presents a novel two-tier optimization framework using a high-level deep reinforcement learning (DRL) model to guide a low-level gradient-based heuristic for local search. The high-level DRL agent employs Leader Reward for optimal rack type ordering, and the low-level heuristic efficiently maps racks to positions, minimizing movement counts and ensuring fault-tolerant resource distribution. This approach allows scalability to over 100,000 positions and 100 rack types. Our method outperformed the gradient-based heuristic by 7\% on average and the MIP solver by over 30\% in objective value. It achieved a 100\% success rate versus MIP's 97.5\% (within a 20-minute limit), completing in just 2 minutes compared to MIP's 1630 minutes (i.e., almost 4 orders of magnitude improvement). Unlike the MIP solver, which showed performance variability under time constraints and high penalties, our algorithm consistently delivered stable, efficient results - an essential feature for large-scale data center management.

arXiv:2504.00274공식 코드 · Papers with Code

Text Chunking for Document Classification for Urban System Management using Large Language Models

Urban systems are managed using complex textual documentation that need coding and analysis to set requirements and evaluate built environment performance. This paper contributes to the study of applying large-language models (LLM) to qualitative coding activities to reduce resource requirements while maintaining comparable reliability to humans. Qualitative coding and assessment face challenges like resource limitations and bias, accuracy, and consistency between human evaluators. Here we report the application of LLMs to deductively code 10 case documents on the presence of 17 digital twin characteristics for the management of urban systems. We utilize two prompting methods to compare the semantic processing of LLMs with human coding efforts: whole text analysis and text chunk analysis using OpenAI's GPT-4o, GPT-4o-mini, and o1-mini models. We found similar trends of internal variability between methods and results indicate that LLMs may perform on par with human coders when initialized with specific deductive coding contexts. GPT-4o, o1-mini and GPT-4o-mini showed significant agreement with human raters when employed using a chunking method. The application of both GPT-4o and GPT-4o-mini as an additional rater with three manual raters showed statistically significant agreement across all raters, indicating that the analysis of textual documents is benefited by LLMs. Our findings reveal nuanced sub-themes of LLM application suggesting LLMs follow human memory coding processes where whole-text analysis may introduce multiple meanings. The novel contributions of this paper lie in assessing the performance of OpenAI GPT models and introduces the chunk-based prompting approach, which addresses context aggregation biases by preserving localized context.

arXiv:2504.00046

Multi-Stakeholder Disaster Insights from Social Media Using Large Language Models

In recent years, social media has emerged as a primary channel for users to promptly share feedback and issues during disasters and emergencies, playing a key role in crisis management. While significant progress has been made in collecting and analyzing social media content, there remains a pressing need to enhance the automation, aggregation, and customization of this data to deliver actionable insights tailored to diverse stakeholders, including the press, police, EMS, and firefighters. This effort is essential for improving the coordination of activities such as relief efforts, resource distribution, and media communication. This paper presents a methodology that leverages the capabilities of LLMs to enhance disaster response and management. Our approach combines classification techniques with generative AI to bridge the gap between raw user feedback and stakeholder-specific reports. Social media posts shared during catastrophic events are analyzed with a focus on user-reported issues, service interruptions, and encountered challenges. We employ full-spectrum LLMs, using analytical models like BERT for precise, multi-dimensional classification of content type, sentiment, emotion, geolocation, and topic. Generative models such as ChatGPT are then used to produce human-readable, informative reports tailored to distinct audiences, synthesizing insights derived from detailed classifications. We compare standard approaches, which analyze posts directly using prompts in ChatGPT, to our advanced method, which incorporates multi-dimensional classification, sub-event selection, and tailored report generation. Our methodology demonstrates superior performance in both quantitative metrics, such as text coherence scores and latent representations, and qualitative assessments by automated tools and field experts, delivering precise insights for diverse disaster response stakeholders.

arXiv:2504.00786공식 코드 · Papers with Code

FeatInsight: An Online ML Feature Management System on 4Paradigm Sage-Studio Platform

Feature management is essential for many online machine learning applications and can often become the performance bottleneck (e.g., taking up to 70% of the overall latency in sales prediction service). Improper feature configurations (e.g., introducing too many irrelevant features) can severely undermine the model's generalization capabilities. However, managing online ML features is challenging due to (1) large-scale, complex raw data (e.g., the 2018 PHM dataset contains 17 tables and dozens to hundreds of columns), (2) the need for high-performance, consistent computation of interdependent features with complex patterns, and (3) the requirement for rapid updates and deployments to accommodate real-time data changes. In this demo, we present FeatInsight, a system that supports the entire feature lifecycle, including feature design, storage, visualization, computation, verification, and lineage management. FeatInsight (with OpenMLDB as the execution engine) has been deployed in over 100 real-world scenarios on 4Paradigm's Sage Studio platform, handling up to a trillion-dimensional feature space and enabling millisecond-level feature updates. We demonstrate how FeatInsight enhances feature design efficiency (e.g., for online product recommendation) and improve feature computation performance (e.g., for online fraud detection). The code is available at https://github.com/4paradigm/FeatInsight.

arXiv:2504.00761

Towards a Decentralised Application-Centric Orchestration Framework in the Cloud-Edge Continuum

The efficient management of complex distributed applications in the Cloud-Edge continuum, including their deployment on heterogeneous computing resources and run-time operations, presents significant challenges. Resource management solutions -- also called orchestrators -- play a pivotal role by automating and managing tasks such as resource discovery, optimisation, application deployment, and lifecycle management, whilst ensuring the desired system performance. This paper introduces Swarmchestrate, a decentralised, application-centric orchestration framework inspired by the self-organising principles of Swarms. Swarmchestrate addresses the end-to-end management of distributed applications, from submission to optimal resource allocation across cloud and edge providers, as well as dynamic reconfiguration. Our initial findings include the implementation of the application deployment phase within a Cloud-Edge simulation environment, demonstrating the potential of Swarmchestrate. The results offer valuable insight into the coordination of resource offerings between various providers and optimised resource allocation, providing a foundation for designing scalable and efficient infrastructures.

arXiv:2503.22706

Validating Emergency Department Admission Predictions Based on Local Data Through MIMIC-IV

The effective management of Emergency Department (ED) overcrowding is essential for improving patient outcomes and optimizing healthcare resource allocation. This study validates hospital admission prediction models initially developed using a small local dataset from a Greek hospital by leveraging the comprehensive MIMIC-IV dataset. After preprocessing the MIMIC-IV data, five algorithms were evaluated: Linear Discriminant Analysis (LDA), K-Nearest Neighbors (KNN), Random Forest (RF), Recursive Partitioning and Regression Trees (RPART), and Support Vector Machines (SVM Radial). Among these, RF demonstrated superior performance, achieving an Area Under the Receiver Operating Characteristic Curve (AUC-ROC) of 0.9999, sensitivity of 0.9997, and specificity of 0.9999 when applied to the MIMIC-IV data. These findings highlight the robustness of RF in handling complex datasets for admission prediction, establish MIMIC-IV as a valuable benchmark for validating models based on smaller local datasets, and provide actionable insights for improving ED management strategies.

arXiv:2503.21963

Coupling plankton and cholera dynamics: insights into outbreak prediction and practical disease management

Despite extensive control efforts over the centuries, cholera remains a globally significant health issue. Seasonal emergence of cholera cases has been reported, particularly in the Bengal delta region, which is often synchronized with plankton blooms. This phenomenon has been widely attributed to the commensal interaction between Vibrio cholerae and zooplankton in aquatic environments. Understanding the role of plankton dynamics in cholera epidemiology is therefore crucial for effective policy-making. To this end, we propose and analyze a novel compartment-based transmission model that integrates phytoplankton-zooplankton interactions into a human-bacteria cholera model. We show that zooplankton-mediated transmission can lead to counterintuitive outcomes, such as an outbreak with a delayed and lower peak still resulting in a larger overall outbreak size. Such outbreaks are prolonged by maintaining infections at lower levels during the post-peak phase, thereby intensifying epidemic overshoot and promoting the inter-epidemic persistence of pathogens. Furthermore, our analysis reveals that the timing of filtration-like interventions can be strategically guided by ecological indicators, such as phytoplankton blooms. Our study underscores the importance of incorporating ecological aspects in epidemiological research to gain a deeper understanding of disease dynamics.

arXiv:2503.23999

Foreign Direct Investment and Job Creation in EU Regions

This study examines the impact of foreign direct investment (FDI) on job creation across 109 regions in the old EU member states from 2012 to 2023. Using dynamic and spatial econometric models combined with a unique dataset of FDI projects, we find that increased FDI inflows significantly enhance regional job creation, but the relationship is nonlinear. Sectoral specialization plays a crucial role, as more concentrated FDI inflows lead to higher employment growth. Furthermore, FDI-driven job creation exhibits significant spatial spillover effects. However, regions attracting high-value FDI jobs, such as those in R&D and management, tend to experience slower overall employment growth.

arXiv:2503.22754

Model Lake: a New Alternative for Machine Learning Models Management and Governance

The rise of artificial intelligence and data science across industries underscores the pressing need for effective management and governance of machine learning (ML) models. Traditional approaches to ML models management often involve disparate storage systems and lack standardized methodologies for versioning, audit, and re-use. Inspired by data lake concepts, this paper develops the concept of ML Model Lake as a centralized management framework for datasets, codes, and models within organizations environments. We provide an in-depth exploration of the Model Lake concept, delineating its architectural foundations, key components, operational benefits, and practical challenges. We discuss the transformative potential of adopting a Model Lake approach, such as enhanced model lifecycle management, discovery, audit, and reusability. Furthermore, we illustrate a real-world application of Model Lake and its transformative impact on data, code and model management practices.

arXiv:2503.22595

Reinforcement Learning for Machine Learning Model Deployment: Evaluating Multi-Armed Bandits in ML Ops Environments

In modern ML Ops environments, model deployment is a critical process that traditionally relies on static heuristics such as validation error comparisons and A/B testing. However, these methods require human intervention to adapt to real-world deployment challenges, such as model drift or unexpected performance degradation. We investigate whether reinforcement learning, specifically multi-armed bandit (MAB) algorithms, can dynamically manage model deployment decisions more effectively. Our approach enables more adaptive production environments by continuously evaluating deployed models and rolling back underperforming ones in real-time. We test six model selection strategies across two real-world datasets and find that RL based approaches match or exceed traditional methods in performance. Our findings suggest that reinforcement learning (RL)-based model management can improve automation, reduce reliance on manual interventions, and mitigate risks associated with post-deployment model failures.

arXiv:2503.12441

Consistent-Point: Consistent Pseudo-Points for Semi-Supervised Crowd Counting and Localization

Crowd counting and localization are important in applications such as public security and traffic management. Existing methods have achieved impressive results thanks to extensive laborious annotations. This paper propose a novel point-localization-based semi-supervised crowd counting and localization method termed Consistent-Point. We identify and address two inconsistencies of pseudo-points, which have not been adequately explored. To enhance their position consistency, we aggregate the positions of neighboring auxiliary proposal-points. Additionally, an instance-wise uncertainty calibration is proposed to improve the class consistency of pseudo-points. By generating more consistent pseudo-points, Consistent-Point provides more stable supervision to the training process, yielding improved results. Extensive experiments across five widely used datasets and three different labeled ratio settings demonstrate that our method achieves state-of-the-art performance in crowd localization while also attaining impressive crowd counting results. The code will be available.

논문 ID: document/9779912

Average Peak Age of Information in Underwater Information Collection With Sleep-Scheduling

We investigate the peak age of information (PAoI) in underwater wireless sensor networks (UWSNs), where Internet of underwater things (IoUT) nodes transmit the latest packets to the sink node, which is in charge of adjusting the sleep-scheduling to match network demands. In order to reduce PAoI, we propose active queue management (AQM) policy of the IoUT node, beneficially compresses the packets having large waiting time. Moreover, we deduce the closed-form expressions of the average PAoI as well as the energy cost relying on probability generating function and matrix-geometric solutions. Numerical results verify that the IoUT node relying on the AQM policy has a lower PAoI and energy cost in comparison to those using non-AQM policy.

arXiv:2503.21606

Fungicides vs mycoinsecticides in the management of corn leafhopper: physicochemical, in vitro and in vivo compatibilities, and degradation kinetics in maize plants

The present study investigates the compatibility of mycoinsecticides based on isolates IBCB66 and Simbi BB15 of Beauveria bassiana and Esalq-1296 of Cordyceps javanica, which are registered for the management of Dalbulus maidis in Brazil, with synthetic fungicides. Irrespective of the fungicide, a total inhibition in the number of colony-forming units (CFUs), vegetative growth, conidiogenesis, and conidial viability of the three tested isolates was observed, with their incompatibility being indicated in the in vitro bioassays. However, the use of formulated mycoinsecticides mitigated the impact of these xenobiotics on the number of CFUs, with the commercial mycoinsecticide FlyControl (B. bassiana isolate Simbi BB15) being the least sensitive to the fungicides propiconazole + difenoconazole, bixafem + prothioconazole + trifloxystrobin and trifloxystrobin + tebuconazole. Nevertheless, an increase in exposure time (from 1.5 to 3 hours) generally led to an increase in the toxicity of fungicides towards entomopathogens. Physical-chemical compatibility assessments indicated that physical incompatibilities were observed, depending on the mycoinsecticide formulation. In addition, in vivo bioassays employing D. maidis adults demonstrated that, despite a synergistic effect on mortality in certain binary mixtures, no cadavers exposed to such mixtures exhibited fungal extrusion. Furthermore, analyses using UHPLC/MS/MS revealed alterations in the degradation kinetics (k) of the active ingredient (a.i.) pyraclostrobin, with changes greater than tenfold being observed in the different formulations of the fungicides that were tested. Consequently, given the diminished degradation kinetics of the active ingredients in maize plants, the implementation of mycoinsecticides should precede, in isolation, the application of synthetic fungicides within the framework of phytosanitary management of maize crops.