第8章データ管理

provides a statistical analysis using a set of processes to solve system problems and find a new market opportunity

storing the data in different servers/sites

client sends a request without waiting for the response

properties that impose a number of constraints to ensure that stored data are reliable and accurate

column header

database that stores data as a block data structure and each block is connected to other blocks by providing cryptographic security and immutability

set of activities, techniques, and tools aimed at understanding patterns in past data to predict the future

states that a distributed computer system cannot guarantee consistency, availability, and partition tolerance at the same time

data are maintained on a centralized server at a single location

technology that detects any data update event and keeps track of versions

DBMS and database are hosted by a third-party cloud provider

single computer that can dramatically improve the performance, availability, and scalability over a single, more powerful machine and at a lower cost by using commodity hardware

technology tries to simulate human’s way in solving problems

database that stores data in column families or tables and is built to manage petabytes of data across a massive, distributed system

person who has theoretical and practical knowledge of computer science.

coordination of transactions that execute simultaneously on the same data so that they do not cause inconsistencies because of mutual interference

manages reports, books, objects, and batches

information and facts that are stored digitally by a computer

whether the data values stored for an object are the correct values and are often correlated with other DQ dimensions

data management technique that uses the cloud to store, process, and manage data

degree to which all data in a specific dataset are available with a minimum percentage of missing data

process that ensures that data practices align with external legal requirements and industry standards

keeping data consistent as it moves between various parts of the system

use of ETL to capture data from multiple sources and integrate it into a single store such as a data warehouse

language used to control access to data stored in a database

language used to create and modify the object structure in a database

translates statements in a high-level language into low-level instructions that the query evaluation engine understands

set of information describing the contents, format, and structure of a database

use of enterprise information integration (EII) to provide a unified view over data sources

set of clear roles, policies, and responsibilities that enables the enterprise to manage and safeguard data quality

providing a consistent view of all organization data

large data repository that stores raw data and can be set up without having to first define the data structure and schema

study of managing data effectively

language used to manipulate and edit data in a database

scaled-down version of a data warehouse aimed at meeting the information needs of a homogeneous small group of end users

abstract model that contains a set of concepts to describe the structure of a database, the operations for manipulating these structures, and certain constraints that the database should obey

person with the authority to ultimately decide on the access to, and usage of, the data

use of enterprise application integration (EAI) corresponding to the synchronous or asynchronous propagation of updates in a source system to a target system

measure of how well the data represents its purpose or fitness for use

includes accuracy, completeness, consistency, and accessibility

language used to make various queries in a database

happens when the same piece of data is held in two separate places in the database

storing data in more than one site to improve the data availability and retrieval performance

person who has theoretical and practical knowledge of managing data

pertains to guaranteeing data integrity, guaranteeing data availability, authentication, access control, guaranteeing confidentiality, auditing, mitigating, and vulnerabilities

person who ensures that the enterprise's actual business data and the metadata are accurate, accessible, secure, and safe

data stored without organization to make retrieval easy

technique that hides the physical location of data and uses data integration patterns to produce a unified data view

centralizes an enterprise’s data from its databases; it supports the flow of data from operational systems to analytics/decision systems by creating a single repository of data from various sources both internal and external

person responsible for the implementation and monitoring of a database and ensuring databases run efficiently

program or piece of software designed to collect, store, access, retrieve, and manage information efficiently and securely

representation of the design that helps design, develop, implement, and maintain the DBMS

person responsible for creating, implementing, and maintaining the database management system

used to write instructions to access and update data in the database

approach where metadata are stored in a catalog

process of structuring a relational database to reduce data redundancy and improve data integrity

activity of setting the database in a consistent state without any data loss in the event of a failure or when any problem occurs

using a set of controls to secure data, guaranteeing a high level of confidentiality

sequence of read/write operations considered to be an atomic unit

person with the privileges to access, analyze, update, and maintain the data

main line of communication between the database and the user

utility for managing and controlling database activities such as loading utility, reorganization utility, performance-monitoring utilities, user management utilities, backup and recovery utility

machine learning method based on artificial neural networks

process of merging several normalized data tables into an aggregated, denormalized data table

patterns of customer behavior

memory device that stores the data such as hard disks, flash memory, magnetic disks, optical disks, and tapes

set of operations that are performed across multiple database systems

defines the domain of values for an attribute

process of making content stemming from databases by offering tools that can be used within the enterprise

specifies that no primary key contains a null

join that combines tables based on matching values in specified columns

process of summarizing and visualizing data for initial insight

data integration that combines data from multiple sources, fixes the data format, and loads the data into a data warehouse

more than one fact table connected to other smaller dimension tables

where presentation logic and application logic are handled by the client; common in cases where it makes sense to couple an application’s workflow

provides a uniform interface to multiple underlying data sources

database that uses a simple structure to store data in a text file; each line in the file holds one record

selection of individual text documents from a collection of documents according to the presence of a single or a combination of search terms in the document

constraint that specifies the relationship between two sets of attributes and provides a formal tool for the analysis of relational schemas

quality of output is determined by the quality of the input

database that represents data as a network of related nodes or objects to facilitate data visualizations and graph analytics

distributed data infrastructures that leverage clusters to store and process massive amounts of data

mathematical technique for processing a query quickly

data model in which the data are organized into a treelike model, DML is procedural and record-oriented, the query processor is logical, and internal data models are intertwined

model in which data are stored in the form of records and organized into a tree structure

rows that satisfy a query predicate, global view with UNION query, and common in NoSQL databases

storing the copies in disks

stores all data in internal memory instead of slower external storage

uses a key, similar to relative organization, but the key is unique and fixed

study, design, and development of information technology for the good of people, organizations, and society

(also, data architect or information analyst) a person responsible for designing the conceptual data model (blueprints) to bridge the gap between the business processes and the IT environment

searching for information in documents using retrieval models that specify matching functions and query representation

represents the intersection of two tables

specifies that all the values of the primary key must be unique

simple database that uses an associative array such as Redis, DynamoDB, and Cosmos DB

separates any changes in the data from the data format

designing a database based on a specific data model but independent of physical details

includes feasibility analysis, requirements collection and analysis, design, implementation, and validation and acceptance testing

open-source software framework used to apply complex queries

series of processes, policies, standards, and tools to help organizations define and provide a single point of reference for all data that are mastered

selection of information from different tables about a specific entity and copying it to an aggregated table

business presentation of metadata

focuses on system definition, database design, database implementation, loading or data conversion, application conversion, testing and validation, operation, monitoring, and maintenance

(also, universe of discourse [UoD]) represents some aspect of the real-world data that is stored in a database

filling an empty field or deleting the field

combines horizontal and vertical fragmentation

database that is more flexible than flat file structures by providing more functionality for creating and updating data

provides storage of multimedia data such as text, images, audio, and video

allows many users to use the database concurrently

occurs when two attributes in a table are independent of each other but both depend on a third attribute

multitier architecture that usually divides an application into three tiers

creates an implicit join based on the common columns in two tables

data are organized into a network model, DML is procedural and record-oriented, the query processor is logical, and internal data models are intertwined

database data model that does not meet any of the conditions of database normalization defined by the relational model

database that does not use a traditional method for storing data such as rows and columns

big unstructured data classified as document, graph, key-value stores, and column-oriented databases

refers to when an object is not deleted until a need emerges to remove it from memory

data model in which the data are organized into an OO data model as no impedance mismatch in combination with the OO host language

focuses on using operational data for tactical or strategical decision-making

focuses on managing operational or transactional data; the database server must be able to process lots of simple transactions per unit of time

semantic data used to describe entities of the real world and the relationship between the entities using the Web Ontology Language (OWL)

publicly available DBMS that can be extended by anyone

staging area that provides query facilities

process of selecting the best plan to execute

union of two tables

value that is outside the population that should be detected in order to apply the handling process on it

technique in which multiple processors work simultaneously on different tasks or different parts of a task to enable concurrent processing of large amounts of data

when an object is independent from how a program manipulates it

concept means that the environment does not require any actions by a program to retrieve or save their state

separates the conceptual level from the physical level

attributes logical concepts to physical constructs

predicts the target measure of interest using regression and classification

special unique identifier for each table record

acts as an intermediary between users and the DBMS data engine to communicate query requests including DML compiler, query parser, query rewriter, query optimizer, and query executor

example of data structure representation for the relational algebra expression

database query language for relational databases based on domain relational calculus

stores information across an array of low-cost hard disks

machine learning method based on encouraging desired behaviors and removing undesired behaviors

mathematical concept based on the ideas of sets

query language that uses unary or binary operators to perform queries

models data into a set of tables with rows and columns

data model in which the data are organized into a relational data model, use SQL as a declarative and set-oriented database, the query processor has a strict separation between the logical and internal data model

when each record is assigned a numeric key to rearrange the order of the records at any time

ratio of net profits divided by the investment of resources

selecting a subset of historical data to build an analytical model

collection of processes used to secure the database from threats

data that are not organized in a formatted database but have some organized properties

records are organized in the order stored and any new record is added at the end

only one user at a time can use the database

data model that normalizes the dimension table

when all records are classified into blocks and the length of the record can exceed the size of a block

data model with one large fact table connected to smaller tables

program that is responsible for editing, storing, updating, deleting, and retrieving data in the database such as transaction manager, buffer manager, lock manager, and recovery manager

data that have been organized into a formatted database and have relational keys

programming language used in programming and managing structured data located in an RDBMS

when the client sends a request and waits for a response from the service

where tables are stored physically in the memory

allows merging two tables based on a theta condition

where only the presentation logic is handled by the client and applications and database commands are executed on the server; it is common when application logic and database logic are tightly coupled or similar

cost of owning and operating the analytical model over time

set of database operations induced by a single user or application that should be considered as one undividable unit of work

delineating transactions within the transaction life cycle

machine learning method based on reusing the result of a specific task to start a new task

process of translating from high-level language to machine language

statement consisting of declarative and/or procedural instructions and stored in the catalog of the RDBMS

one row with a collection of values separated by a comma and enclosed in parenthesis

database that stores data in XML or JSON format with the document name as key and the contents of the document as value

specifies that all the tuples must be unique

data that are not organized in a formatted database and do not have organized properties

actual value derived using the total cost of ownership (TCO) and return on investment (ROI) of the data

range of data types and sources that are used; data in its many forms

speed at which data comes in and goes out; data in motion

uncertainty of the data; data in doubt

subset of columns of data, global view with JOIN query, and useful if only some of a tuple’s attributes are relevant to a node

usually defined as a single SQL view

can be built as a set of SQL views directly on the underlying operational data sources as an extra layer on top of a collection of physical independent data marts

amount of data; data at rest

type of entity that cannot be uniquely identified based on its attributes alone and must rely on a strong entity to provide the context necessary for identification

data model in which the data are using the XML data model to store data