IT数码 购物 网址 头条 软件 日历 阅读 图书馆
TxT小说阅读器
↓语音阅读,小说下载,古典文学↓
图片批量下载器
↓批量下载图片,美女图库↓
图片自动播放器
↓图片自动播放器↓
一键清除垃圾
↓轻轻一点,清除系统垃圾↓
开发: C++知识库 Java知识库 JavaScript Python PHP知识库 人工智能 区块链 大数据 移动开发 嵌入式 开发工具 数据结构与算法 开发测试 游戏开发 网络协议 系统运维
教程: HTML教程 CSS教程 JavaScript教程 Go语言教程 JQuery教程 VUE教程 VUE3教程 Bootstrap教程 SQL数据库教程 C语言教程 C++教程 Java教程 Python教程 Python3教程 C#教程
数码: 电脑 笔记本 显卡 显示器 固态硬盘 硬盘 耳机 手机 iphone vivo oppo 小米 华为 单反 装机 图拉丁
 
   -> 大数据 -> Redis持久化-AOF -> 正文阅读

[大数据]Redis持久化-AOF

目录

1 什么是AOP

2?appendonly.aof文件

3 Rewrite

?3.1 什么是rewrite

?3.2 重写原理

? 3.3 触发机制

4 AOF的优缺点

5 总结

5.1 rdb和aof比较

5.2 同时开启两种持久化方式


1 什么是AOP

以日志的形式记录每个写操作,将redis执行过的所有写指令记录下来(读操作不记录),只许追加文件,但不许改写文件,redis启动之初会读取该文件重新构建数据,换言之,redis重启的话就是根据日志文件的内容将写指令从前到后执行一次以完成数据的恢复工作

2?appendonly.aof文件

############################## APPEND ONLY MODE ###############################

# By default Redis asynchronously dumps the dataset on disk. This mode is
# good enough in many applications, but an issue with the Redis process or
# a power outage may result into a few minutes of writes lost (depending on
# the configured save points).
#
# The Append Only File is an alternative persistence mode that provides
# much better durability. For instance using the default data fsync policy
# (see later in the config file) Redis can lose just one second of writes in a
# dramatic event like a server power outage, or a single write if something
# wrong with the Redis process itself happens, but the operating system is
# still running correctly.
#
# AOF and RDB persistence can be enabled at the same time without problems.
# If the AOF is enabled on startup Redis will load the AOF, that is the file
# with the better durability guarantees.
#
# Please check https://redis.io/topics/persistence for more information.

appendonly no

# The name of the append only file (default: "appendonly.aof")

appendfilename "appendonly.aof"

# The fsync() call tells the Operating System to actually write data on disk
# instead of waiting for more data in the output buffer. Some OS will really flush
# data on disk, some other OS will just try to do it ASAP.
#
# Redis supports three different modes:
#
# no: don't fsync, just let the OS flush the data when it wants. Faster.
# always: fsync after every write to the append only log. Slow, Safest.
# everysec: fsync only one time every second. Compromise.
#
# The default is "everysec", as that's usually the right compromise between
# speed and data safety. It's up to you to understand if you can relax this to
# "no" that will let the operating system flush the output buffer when
# it wants, for better performances (but if you can live with the idea of
# some data loss consider the default persistence mode that's snapshotting),
# or on the contrary, use "always" that's very slow but a bit safer than
# everysec.
#
# More details please check the following article:
# http://antirez.com/post/redis-persistence-demystified.html
#
# If unsure, use "everysec".

# appendfsync always
appendfsync everysec
# appendfsync no

# When the AOF fsync policy is set to always or everysec, and a background
# saving process (a background save or AOF log background rewriting) is
# performing a lot of I/O against the disk, in some Linux configurations
# Redis may block too long on the fsync() call. Note that there is no fix for
# this currently, as even performing fsync in a different thread will block
# our synchronous write(2) call.
#
# In order to mitigate this problem it's possible to use the following option
# that will prevent fsync() from being called in the main process while a
# BGSAVE or BGREWRITEAOF is in progress.
#
# This means that while another child is saving, the durability of Redis is
# the same as "appendfsync none". In practical terms, this means that it is
# possible to lose up to 30 seconds of log in the worst scenario (with the
# default Linux settings).
#
# If you have latency problems turn this to "yes". Otherwise leave it as
# "no" that is the safest pick from the point of view of durability.

no-appendfsync-on-rewrite no

# Automatic rewrite of the append only file.
# Redis is able to automatically rewrite the log file implicitly calling
# BGREWRITEAOF when the AOF log size grows by the specified percentage.
#
# This is how it works: Redis remembers the size of the AOF file after the
# latest rewrite (if no rewrite has happened since the restart, the size of
# the AOF at startup is used).
#
# This base size is compared to the current size. If the current size is
# bigger than the specified percentage, the rewrite is triggered. Also
# you need to specify a minimal size for the AOF file to be rewritten, this
# is useful to avoid rewriting the AOF file even if the percentage increase
# is reached but it is still pretty small.
#
# Specify a percentage of zero in order to disable the automatic AOF
# rewrite feature.

auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 64mb

appendonly no

appendonly no 表示不开aof快照存储,appendonly yes表示开启快照存储

# The name of the append only file (default: "appendonly.aof")

appendfilename "appendonly.aof"

aof快照名称默认为:?appendonly.aof

# appendfsync always

appendfsync everysec

# appendfsync no

alaways: 同步持久化 每次发生数据变更会被立即记录到磁盘 性能较差但数据完整性较好

everysec:出厂异步推荐,异步操作,每秒记录 如果一秒内宕机,有数据丢失

no:

no-appendfsync-on-rewrite no

重写时是否可以运用Appendfsync,用默认no即可,保证数据安全性

auto-aof-rewrite-percentage 100

auto-aof-rewrite-min-size 64mb

设置重写的基准值

注意:appendonly.aof和dump.rdb可以放在同一bin目录下,启动时会优先找appendonly.aof文件。

如果此时redis启动失败,肯能是appendonly.aof文件中由于一些网络延时,丢包等原因产生了一些redis不能解析的语法,此时可以执行redis-check-aof --fix?appendonly.aof命令会自动检查并修正错误的语法。

3 Rewrite

?3.1 什么是rewrite

?AOF采用文件追加的方式,文件会越来越大为避免出现此种情况,新增了重写机制,当aof的文件大小超过所设定的阀值时,redis就会启动aof文件的内容压缩,只保留可以恢复数据的最小指令集,可以使用bgrewriteaof

3.2 重写原理

aof文件持续增长过大时,会fork出一条新进程来将文件重写(也是先写临时文件最后再rename),遍历新进程的内存中数据,每条记录都有一条set语句。重写aof文件的操作,并没有读取旧的aof文件,而是将整个内存中的数据库内容用命令的方式重新写了一个新的aof文件,这点和快照有些类似

? 3.3 触发机制

redis会记录上次重写时aof的大小,默认配置是当aof文件大小是上次rewrite后大小的一倍且文件大于64m时触发

4 AOF的优缺点

优点:可以灵活的配置同步规则

每秒同步:appendfsync?alaways: 同步持久化 每次发生数据变更会被立即记录到磁盘 性能较差但数据完整性较好

每修改同步:appendfsync?everysec:出厂异步推荐,异步操作,每秒记录 如果一秒内宕机,有数据丢失

不同步:appendfsync?no:

缺点:

1)相同数据集的数据而言aof文件要远大于rdb文件,恢复速度慢于rdb

2)aof运行效率要慢于rdb,每秒同步策略效率较好,不同步效率和rdb相同

5 总结

5.1 rdb和aof比较

RDB持久化方式能够在指定的时间间隔内对数据进行快照存储

AOF持久化方式记录每次对服务器写的?操作,当服务器重写的时候会重新执行这些命令来恢复原始的数据,AOF命令以redis协议追加保存每次写的操作到文件末尾,Redis还能对AOF文件进行后台重写,使得AOF文件的体积不至于过大

如果只希望数据在服务器运行的时候存在,也可以不选择任何持久化方式

5.2 同时开启两种持久化方式

在这种情况下,当redis重启时会优先载入AOF文件来恢复原始的数据。因为在通常的情况下AOF文件保存的数据比RDB文件保存到数据要完整。RDB的数据不实时,同时使用两者时服务器重启也会只找AOF文件(并不代表我们只使用AOF就可),因为RDB更适合于用于备份数据库(AOF在不断变化不好备份)快速重启,而且不会有aof可能潜在的bug。

  大数据 最新文章
实现Kafka至少消费一次
亚马逊云科技:还在苦于ETL?Zero ETL的时代
初探MapReduce
【SpringBoot框架篇】32.基于注解+redis实现
Elasticsearch:如何减少 Elasticsearch 集
Go redis操作
Redis面试题
专题五 Redis高并发场景
基于GBase8s和Calcite的多数据源查询
Redis——底层数据结构原理
上一篇文章      下一篇文章      查看所有文章
加:2022-02-04 11:06:05  更:2022-02-04 11:07:25 
 
开发: C++知识库 Java知识库 JavaScript Python PHP知识库 人工智能 区块链 大数据 移动开发 嵌入式 开发工具 数据结构与算法 开发测试 游戏开发 网络协议 系统运维
教程: HTML教程 CSS教程 JavaScript教程 Go语言教程 JQuery教程 VUE教程 VUE3教程 Bootstrap教程 SQL数据库教程 C语言教程 C++教程 Java教程 Python教程 Python3教程 C#教程
数码: 电脑 笔记本 显卡 显示器 固态硬盘 硬盘 耳机 手机 iphone vivo oppo 小米 华为 单反 装机 图拉丁

360图书馆 购物 三丰科技 阅读网 日历 万年历 2024年11日历 -2024/11/24 12:41:43-

图片自动播放器
↓图片自动播放器↓
TxT小说阅读器
↓语音阅读,小说下载,古典文学↓
一键清除垃圾
↓轻轻一点,清除系统垃圾↓
图片批量下载器
↓批量下载图片,美女图库↓
  网站联系: qq:121756557 email:121756557@qq.com  IT数码