scispace - formally typeset
Search or ask a question

Showing papers on "Batch file published in 2019"


Proceedings ArticleDOI
20 May 2019
TL;DR: A novel batch-file access approach is proposed, referred to as BFO for its set of optimized Batch-File Operations, by developing novel BFOr and BFOw operations for fundamental read and write processes respectively, using a two-phase access for metadata and data jointly.
Abstract: Existing local file systems, designed to support a typical single-file access pattern only, can lead to poor performance when accessing a batch of files, especially small files. This single-file pattern essentially serializes accesses to batched files one by one, resulting in a large number of non-sequential, random, and often dependent I/Os between file data and metadata at the storage ends. We first experimentally analyze the root cause of such inefficiency in batch-file accesses. Then, we propose a novel batch-file access approach, referred to as BFO for its set of optimized Batch-File Operations, by developing novel BFOr and BFOw operations for fundamental read and write processes respectively, using a two-phase access for metadata and data jointly. The BFO offers dedicated interfaces for batch-file accesses and additional processes integrated into existing file systems without modifying their structures and procedures. We implement a BFO prototype on ext4, one of the most popular file systems. Our evaluation results show that the batch-file read and write performances of BFO are consistently higher than those of the traditional approaches regardless of access patterns, data layouts, and storage media, with synthetic and real-world file sets. BFO improves the read performance by up to 22.4× and 1.8× with HDD and SSD respectively; and boosts the write performance by up to 111.4× and 2.9× with HDD and SSD respectively. BFO also demonstrates consistent performance advantages when applied to four representative applications, Linux cp, Tar, GridFTP, and Hadoop.

4 citations



Patent
09 May 2019
TL;DR: In this article, a method and system for managing exceptions during reconciliation of transactions, wherein the exceptions are raised for possible mismatches existing between data sets being compared, is presented, where only possible close matches are retrieved based on a predefined confidence score threshold.
Abstract: A method and system for managing of exceptions during reconciliation of transactions, wherein the exceptions are raised for possible mismatches existing between data sets being compared. The reconciliation includes performing a first matching of the two sets based on a predefined rule set and a preset reconciliation type, wherein the first matching raises the exceptions. Further, the exceptions, as a batch file, are processed by performing a second matching for the exception-data based on pattern matching mechanism that utilizes fuzzy logic. The pattern matching mechanism is provided with metafiles corresponding to each batch element of the batch files. Further, only possible close matches are retrieved based on a predefined confidence score threshold. The close matches along with corresponding confidence score may be provided to a user on a User is Interface (UI) for further investigation of the exceptions.

2 citations


Patent
23 Aug 2019
TL;DR: In this article, a file batch processing method and device, computer equipment and a storage medium is described, which comprises the following steps of detecting a batch selection starting instruction; starting file batch selection function, when the filebatch selection function is in a starting state; obtaining touch screen point information of each high-frequency signal generated by interaction between a user and a touch screen area, according to the touch-screen point information, generating a target sliding trajectory, depending on the target sliding trajectories, determining selected files, taking the selected file as an initial file, and if a batch
Abstract: The invention discloses a file batch processing method and device, computer equipment and a storage medium. The method comprises the following steps of: detecting a batch selection starting instruction; starting file batch selection function, when the file batch selection function is in a starting state; obtaining touch screen point information of each high-frequency signal generated by interaction between a user and a touch screen area, according to the touch screen point information, generating a target sliding trajectory, depending on a target sliding trajectory, determining selected files,taking the selected file as an initial file; if a batch selection termination instruction is received, and if yes, terminating the file batch selection function, taking the obtained initial file as atarget file, obtaining an operation instruction, and executing an operation corresponding to the operation instruction on each selected file in the target file according to the operation instruction,thereby realizing quick execution operation on the batch files, and improving the efficiency of the batch file operation.

1 citations


Patent
29 Mar 2019
TL;DR: In this article, the authors propose a method for upgrading the firmware of a monitor in batches, where the host computer and themonitor are in the same network segment, and a host computer transmits files to the monitor through a TFTP protocol.
Abstract: The technical proposal of the invention comprises a method for upgrading the firmware of a monitor in batches. A host computer is used for upgrading a plurality of monitors. The host computer and themonitor are in the same network segment and the host computer transmits files to the monitor through a TFTP protocol. The method comprises the following steps: S100, the host computer starts Telnet byrunning the upgrade batch file, and sequentially logs in the monitor to be upgraded; S200, after logging in a monitor to be upgraded, the host computer automatically sends the prepared upgrade firmware package and upgrade script to the local memory of the monitor through the TFTP protocol; S300, the monitor automatically calls the upgrade script in the local memory to use the upgrade firmware package to complete the burning and upgrading of the monitor firmware; S400, repeating step S200-S300, until all monitors to be upgraded have been upgraded. The method only needs to run a batch of processing files at one time to complete the firmware upgrade of all monitors to be upgraded. The operation is simple and the upgrade is stable and reliable.

1 citations


Patent
18 Jan 2019
TL;DR: In this article, a test method and device for solid-state hard disk and computer storage medium is presented, which can automatically realize the restart or shutdown of the client, can complete the test of the hard disk without manual participation, save human resources and test time, improves the test efficiency, and can be tested by multiple clients at the same time.
Abstract: The invention discloses a test method and device for solid state hard disk and computer storage medium. After receiving an installation command, the method includes installing PassMark Rebooter software on a client machine installed with the solid-state hard disk according to the command, and setting the client machine according to an input restart parameter; then creating a bat file that containsthe commands to invoke the test script. The software can realize the automatic shutdown or restart of the client within a specified time, and the bat file is a batch file, which contains the commandto invoke the test script. Therefore, the test script can be executed automatically after the client starts up to complete the test of the solid state hard disk. The method can automatically realize the restart or shutdown of the client, can complete the test of the solid-state hard disk without manual participation, saves human resources and test time, improves the test efficiency, and can be tested by multiple clients at the same time.

1 citations


Patent
05 Nov 2019
TL;DR: In this article, a data processing method for web page processing is presented, where a Python rear end obtains data processing instruction, receives data processing results, and generates a batch file according to the data processing result, so as to enable a Unity front end to use a preset interface to read the batch file and carry out page display.
Abstract: The embodiment of the invention discloses a data processing method. The data processing method comprises the following steps: a Python rear end obtains a data processing instruction, obtains data processing results according to the data processing instruction, and generates a batch file according to data processing results, so as to enable a Unity front end to use a preset interface to read the batch file and carry out page display according to the batch file, therefore, normal interaction of the Python rear end and the Unity front end is realized, and further webpage normal operation of the Python rear end and the Unity front end is realized. The embodiment of the invention further discloses a data processing device, web page processing equipment, system and a storage medium.

1 citations


Patent
17 Oct 2019
TL;DR: In this paper, a batch file auditing and entrustment payment method and system is presented, the method comprising: step 1, acquiring batch service files from an access party and storing into a network memory, acquiring a file name, adding the file name into a batch order acceptance form of a database, and then waiting to start a delivery task.
Abstract: The present application relates to a batch file auditing and entrustment payment method and system, the method comprising: step 1, acquiring batch service files from an access party and storing into a network memory, acquiring a file name, adding the file name into a batch order acceptance form of a database, and then waiting to start a delivery task; step 2, regularly starting the delivery task: according to the file name in the batch order acceptance form, downloading a first batch of service files from the network memory, and performing format verification to the first batch of service files; step 3, according to a service record parsed from the first batch of service files, forming a batch service list, filtering an illegal service record in the batch service list, and thereby generating a second batch of service files; and step 4, according to the second batch of service files, performing a batch payment operation, and ending the method. The present application can ensure the smooth progress of a transaction, improve fund effective utilization, and improve operation efficiency and user experience.

Patent
05 Dec 2019
TL;DR: In this article, a batch file partial return processing method and system is presented, which comprises the following steps: step 1, performing regular polling on a payment channel, and acquiring a first return file, wherein the first file contains records needing to be returned to an access party; step 2, importing the records in the first return files into a database; step 3, extracting the records needing TO be returned from the database, as current records, and gathering the current records to form a second return file; step 4, pushing the second return files to the access party and acquiring pushing
Abstract: The present application relates to a batch file partial return processing method and system. The method comprises the following steps: step 1, performing regular polling on a payment channel, and acquiring a first return file, wherein the first return file contains records needing to be returned to an access party; step 2, importing the records in the first return file into a database; step 3, extracting the records needing to be returned to the access party from the database, as current records, and gathering the current records to form a second return file; step 4, pushing the second return file to the access party and acquiring a pushing state; and step 5, updating states of the current records in the database according to the pushing state. The present application can ensure the smooth progress of a transaction, improve effective utilization of funds, and improve operating efficiency and the user experience.


Patent
09 Aug 2019
TL;DR: In this paper, a network communication method and system based on batch coding is described, where each data file comprises a plurality of first data packets and each data packet is sent to a next node through a physical layer.
Abstract: The invention discloses a network communication method and system based on batch coding. The method comprises the following steps that S100, enabling a transmission layer in a source node to receive data files, wherein each data file comprises a plurality of first data packets; S210, encoding the plurality of first data packets by the batch-encoded outer code to generate a batch containing a plurality of second data packets; S220, recoding the plurality of second data packets in the batch to generate a batch containing a plurality of third data packets by the internal code of the batch code, and then sending the batch to a next node through a physical layer; S300, performing joint decoding of a physical layer and a network layer on the batch-coded internal codes to generate a batch containing a plurality of second data packets; S400, when the batch is received by the network layer, detecting whether the current node is a target node, if not, performing the step S220, and if yes, performing the step S500; and S500, carrying out joint decoding on the received multiple batches, and recovering the data file.

Patent
15 Feb 2019
TL;DR: In this article, a fault processing method and device of batch jobs among banking systems is described. But the method comprises the steps of checking batch files in delayed transmission between upstream and downstream systems according to a preset time interval and transmitting the batch files which are confirmed to be all at present to the downstream system.
Abstract: The invention discloses a fault processing method and device of batch jobs among banking systems. The method comprises the steps of checking batch files in delayed transmission between upstream and downstream systems according a preset time interval and transmitting the batch files which are confirmed to be all at present to the downstream system; comparing the number of files generated in batcheswith the number of files in a transmission log; if judging that the number is inconsistent, retransmitting the batch files according to the preset time interval for the preset number of times; and performing debit and credit balancing on a wrong general ledger text in batch jobs by utilizing a preset business accounting code.

Patent
04 Apr 2019
TL;DR: In this article, a method for debugging a driver of a liquid crystal display module is presented, where a PC terminal inputting original parameters to a driver file of a mobile terminal (S330), the PC terminal editing a batch script as required (S340), and performing batch reading/writing of the original parameters.
Abstract: A method for debugging a driver of a liquid crystal display module comprises: a PC terminal inputting original parameters to a driver file of a liquid crystal display module of a mobile terminal (S330); the PC terminal editing a batch script as required (S340); and performing batch reading/writing of the original parameters. Also provided is a system for debugging a driver of a liquid crystal display module. The above method and system create a plurality of index nodes, data nodes and original parameter nodes in a driver file to perform operations on a plurality of indices, store data and read original parameters without relying on a specific platform, can be transferred to any platform, and employ simple coding principles and straightforward code.

Patent
15 Jan 2019
TL;DR: In this article, a data copying method of a U disk, which comprises the following steps: when an activation signal of the U disk is received, running a batch file to obtain a disk letter address of the u disk; copying the file contents corresponding to the preset directory in the batch file, to the disk letter letter address; when the copying of the contents of the file is completed, prompt information is sent according to a preset path so as to complete the data copying operation of U disk.
Abstract: The invention discloses a data copying method of a U disk, which comprises the following steps: when an activation signal of the U disk is received, running a batch file to obtain a disk letter address of the U disk; Copying the file contents corresponding to the preset directory in the batch file to the disk letter address; when the copying of the contents of the file is completed, prompt information is sent according to the preset path so as to complete the data copying operation of the U disk. By automatically identifying the letter address of the USB drive, the file contents in the presetdirectory are automatically copied to the obtained disk letter address, and the corresponding prompt operation is carried out when the copying is completed, thereby realizing the automatic copying function of the file contents in the preset directory, avoiding the error operation of manual copying, and improving the reliability of the pre-test process. The invention also discloses a data copying device of a U disk, a device and a computer-readable storage medium, which have the above beneficial effects.

Patent
15 Oct 2019
TL;DR: In this article, a data processing method and a device, a server and a storage medium for big data processing is described, which relates to the technical field of big data Processing.
Abstract: The invention provides a data processing method and a device, a server and a storage medium, and relates to the technical field of big data processing The method comprises the steps receiving a plurality of event requests, each event request is an event request corresponding to a tracking event triggered by an operation behavior of a user, and each event request comprises data corresponding to the operation behavior; generating a plurality of batch files, wherein each batch file comprises data included in at least one event request; responding to the generation operation of each batch file, and triggering a calling instruction corresponding to each batch file; and sending a calling instruction to the cloud server, the calling instruction being used for calling the service-free applicationon the cloud server and processing each batch file The generated batch files are processed in batches by adopting the service-free application on the cloud server, and when a plurality of batch files appear, the system can automatically expand the plurality of applications to process the batch files, so that the flexibility of cluster system expansion is realized

Patent
08 Oct 2019
TL;DR: In this article, a batch file generation method and system is described, where the file generation information comprises file names, file types and directory structures of a plurality of to-be-built files.
Abstract: The invention discloses a batch file generation method and system. The method comprises the following steps: receiving a file creation instruction; calling pre-stored file generation information corresponding to the new building instruction, wherein the file generation information comprises file names, file types and directory structures of a plurality of to-be-built files; generating a corresponding file in the corresponding directory structure by utilizing the file generation information. File generation information of a large number of to-be-built files is stored in advance. Therefore, in order to establish files in batch,a user terminal can generate files on a large scale according to the file name, the directory structure and other information recorded by each to-be-established file in the file generation information only by calling the file generation information, manual file generation is not needed, tedious use of file copying, link establishment and other functions for file creation is not needed, and the file creation efficiency is improved.