forked from huataihuang/cloud-atlas-draft
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
d65a5b9
commit de6c347
Showing
19 changed files
with
259 additions
and
27 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
Spark机器学习 | ||
|
||
# GPU加速Spark | ||
|
||
* [nvidia提供GPU加速Spark支持](https://www.nvidia.com/en-us/deep-learning-ai/solutions/data-science/apache-spark-3/) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
我购买了一台二手的Pixel XL,将实践自己编译LineageOS系统。 | ||
|
||
# 参考 | ||
|
||
* [Build lineageos for marlin](https://wiki.lineageos.org/devices/marlin/build) | ||
* [marlin设备的LineageOS相关信息](https://wiki.lineageos.org/devices/marlin) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Empty file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,19 @@ | ||
groovy可以使用 `|` 来表示 `或` ,在字符串分隔时可以使用 | ||
|
||
```groovy | ||
String[]tokens = pdfName.split("-|\\."); | ||
``` | ||
|
||
可以将 `AA.BB-CC-DD.zip` 切分成 | ||
|
||
``` | ||
AA | ||
BB | ||
CC | ||
DD | ||
zip | ||
``` | ||
|
||
# 参考 | ||
|
||
* [Use String.split() with multiple delimiters](https://stackoverflow.com/questions/5993779/use-string-split-with-multiple-delimiters) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,73 @@ | ||
# 安装groovy | ||
|
||
## 下载软件zip包安装 | ||
|
||
从 [groovy官网](http://www.groovy-lang.org/) 下载 [apache-groovy-sdk-3.0.5.zip](https://dl.bintray.com/groovy/maven/apache-groovy-binary-3.0.5.zip) 安装方法参考 [Install Groovy](http://groovy-lang.org/install.html) | ||
|
||
```bash | ||
unzip apache-groovy-sdk-3.0.5.zip -d /usr/local | ||
``` | ||
|
||
上述指定解压缩目录到 `/usr/local` 下,就可以通过 `/usr/local/bin/groovy` 来使用了。 | ||
|
||
> Groovy 3.0运行需要Java 6+到Java 8,目前在Java 9 snapshots上运行还有一些问题。建议使用Java 8。[macOS上使用多个JDK版本](https://cloud-atlas.readthedocs.io/zh_CN/latest/macos_ios/studio/multi_jdk_on_macos.html) | ||
> 如果想要将Groovy嵌入到应用程序,需要使用合适的 maven repositories或者 [JCenter maven repository](https://oss.jfrog.org/oss-release-local/org/codehaus/groovy) | ||
例如在maven配置中添加: | ||
|
||
```xml | ||
<groupId>org.codehaus.groovy</groupId> | ||
<artifactId>groovy</artifactId> | ||
<version>3.0.5</version> | ||
``` | ||
|
||
如果是使用gradle构建,则添加 | ||
|
||
``` | ||
'org.codehaus.groovy:groovy:3.0.5' | ||
``` | ||
|
||
## 通过SDKMAN!安装 | ||
|
||
* 更为简单的安装方法是使用脚本安装 | ||
|
||
```bash | ||
curl -s get.sdkman.io | bash | ||
``` | ||
|
||
* 然后开启一个新的终端,或者输入命令: | ||
|
||
```bash | ||
source "/Users/huatai/.sdkman/bin/sdkman-init.sh" | ||
``` | ||
|
||
* 最后执行以下命令安装最新的stable Groovy: | ||
|
||
```bash | ||
sdk install groovy | ||
``` | ||
|
||
> 通过 SDKMAN!安装不需要root权限,安装以后执行程序位于 `/Users/huatai/.sdkman/candidates/groovy/current/bin/groovy` | ||
# 运行groovy | ||
|
||
通过运行一些简单的脚本或者交互ide来验证groovy安装是否成功。 | ||
|
||
* 启动groovy shell: | ||
|
||
```bash | ||
groovysh | ||
``` | ||
|
||
* 或者启动一个groovyConsole图形交互控制台: | ||
|
||
```bash | ||
groovyConsole | ||
``` | ||
|
||
* 或者执行任何Groovy脚本: | ||
|
||
```bash | ||
groovy SomeScript | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
ECS虚拟机启动中有关于MSR报错,可能和处理器idle有关,后续需要分析 | ||
|
||
``` | ||
[Sat Jun 20 23:42:04 2020] intel_idle: MWAIT substates: 0x2020 | ||
[Sat Jun 20 23:42:04 2020] intel_idle: v0.4.1 model 0x55 | ||
[Sat Jun 20 23:42:04 2020] tsc: Marking TSC unstable due to TSC halts in idle states deeper than C2 | ||
[Sat Jun 20 23:42:04 2020] unchecked MSR access error: RDMSR from 0x1fc at rIP: 0xffffffff9a861db3 (native_read_msr+0x3/0x30) | ||
[Sat Jun 20 23:42:04 2020] Call Trace: | ||
[Sat Jun 20 23:42:04 2020] intel_idle_cpu_online+0x6c/0xf0 | ||
[Sat Jun 20 23:42:04 2020] cpuhp_invoke_callback+0x8d/0x500 | ||
[Sat Jun 20 23:42:04 2020] ? sort_range+0x20/0x20 | ||
[Sat Jun 20 23:42:04 2020] cpuhp_thread_fun+0xcb/0x130 | ||
[Sat Jun 20 23:42:04 2020] smpboot_thread_fn+0xc5/0x160 | ||
[Sat Jun 20 23:42:04 2020] kthread+0x112/0x130 | ||
[Sat Jun 20 23:42:04 2020] ? kthread_flush_work_fn+0x10/0x10 | ||
[Sat Jun 20 23:42:04 2020] ret_from_fork+0x35/0x40 | ||
[Sat Jun 20 23:42:04 2020] unchecked MSR access error: WRMSR to 0x1fc (tried to write 0x0000000000000000) at rIP: 0xffffffff9a861f14 (native_write_msr+0x4/0x20) | ||
[Sat Jun 20 23:42:04 2020] Call Trace: | ||
[Sat Jun 20 23:42:04 2020] intel_idle_cpu_online+0x83/0xf0 | ||
[Sat Jun 20 23:42:04 2020] cpuhp_invoke_callback+0x8d/0x500 | ||
[Sat Jun 20 23:42:04 2020] ? sort_range+0x20/0x20 | ||
[Sat Jun 20 23:42:04 2020] cpuhp_thread_fun+0xcb/0x130 | ||
[Sat Jun 20 23:42:04 2020] smpboot_thread_fn+0xc5/0x160 | ||
[Sat Jun 20 23:42:04 2020] kthread+0x112/0x130 | ||
[Sat Jun 20 23:42:04 2020] ? kthread_flush_work_fn+0x10/0x10 | ||
[Sat Jun 20 23:42:04 2020] ret_from_fork+0x35/0x40 | ||
[Sat Jun 20 23:42:04 2020] intel_idle: lapic_timer_reliable_states 0x2 | ||
``` |
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
内核调度 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,56 @@ | ||
Linux系统日志 | ||
|
||
```bash | ||
[Tue Jul 21 07:02:43 2020] ------------[ cut here ]------------ | ||
[Tue Jul 21 07:02:43 2020] rq->tmp_alone_branch != &rq->leaf_cfs_rq_list | ||
[Tue Jul 21 07:02:43 2020] WARNING: CPU: 11 PID: 0 at kernel/sched/fair.c:368 unthrottle_cfs_rq+0x274/0x290 | ||
[Tue Jul 21 07:02:43 2020] Modules linked in: nft_chain_nat_ipv6 nf_conntrack_ipv6 nf_nat_ipv6 xt_statistic ipt_REJECT nf_reject_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_defrag_ipv6 nft_chain_route_ipv4 xt_comment xt_mark xt_nat veth xt_conntrack ipt_MASQUERADE nf_conntrack_netlink nft_counter xt_addrtype nft_compat nft_chain_nat_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack nf_tables nfnetlink br_netfilter bridge stp llc overlay fuse xfs libcrc32c intel_rapl_msr intel_rapl_common nfit libnvdimm crct10dif_pclmul crc32_pclmul cirrus ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm joydev virtio_balloon pcspkr i2c_piix4 ip_tables ext4 mbcache jbd2 ata_generic ata_piix libata virtio_net crc32c_intel net_failover virtio_console serio_raw virtio_blk failover | ||
[Tue Jul 21 07:02:43 2020] Features: eBPF/cgroup | ||
[Tue Jul 21 07:02:43 2020] CPU: 11 PID: 0 Comm: swapper/11 Kdump: loaded Not tainted 4.18.0-193.6.3.el8_2.x86_64 #1 | ||
[Tue Jul 21 07:02:43 2020] Hardware name: Alibaba Cloud Alibaba Cloud ECS, BIOS 8c24b4c 04/01/2014 | ||
[Tue Jul 21 07:02:43 2020] RIP: 0010:unthrottle_cfs_rq+0x274/0x290 | ||
[Tue Jul 21 07:02:43 2020] Code: 8a 05 00 e9 ff fe ff ff 31 db 80 3d 0b 5b 2d 01 00 0f 85 cf fe ff ff 48 c7 c7 58 3d c9 ae c6 05 f7 5a 2d 01 01 e8 26 02 fc ff <0f> 0b 48 85 db 0f 85 d2 fe ff ff e9 ac fe ff ff e8 a7 89 05 00 e9 | ||
[Tue Jul 21 07:02:43 2020] RSP: 0018:ffff9dffdfac3e70 EFLAGS: 00010082 | ||
[Tue Jul 21 07:02:43 2020] RAX: 0000000000000000 RBX: ffff9dfb69998400 RCX: 0000000000000000 | ||
[Tue Jul 21 07:02:43 2020] RDX: 000000000000002d RSI: ffffffffaf81af4d RDI: 0000000000000046 | ||
[Tue Jul 21 07:02:43 2020] RBP: ffff9dfb38190c00 R08: ffffffffaf81af20 R09: 000000000000002d | ||
[Tue Jul 21 07:02:43 2020] R10: 0000000000000000 R11: 000000008000000b R12: ffff9dffdf9a9c40 | ||
[Tue Jul 21 07:02:43 2020] R13: 0000000000000002 R14: 0000000000000001 R15: 0000000000000001 | ||
[Tue Jul 21 07:02:43 2020] FS: 0000000000000000(0000) GS:ffff9dffdfac0000(0000) knlGS:0000000000000000 | ||
[Tue Jul 21 07:02:43 2020] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 | ||
[Tue Jul 21 07:02:43 2020] CR2: 00007fb1159234f4 CR3: 000000052760a005 CR4: 00000000003606e0 | ||
[Tue Jul 21 07:02:43 2020] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 | ||
[Tue Jul 21 07:02:43 2020] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 | ||
[Tue Jul 21 07:02:43 2020] Call Trace: | ||
[Tue Jul 21 07:02:43 2020] <IRQ> | ||
[Tue Jul 21 07:02:43 2020] distribute_cfs_runtime+0xc3/0x140 | ||
[Tue Jul 21 07:02:43 2020] sched_cfs_period_timer+0x108/0x210 | ||
[Tue Jul 21 07:02:43 2020] ? sched_cfs_slack_timer+0xe0/0xe0 | ||
[Tue Jul 21 07:02:43 2020] __hrtimer_run_queues+0x100/0x280 | ||
[Tue Jul 21 07:02:43 2020] hrtimer_interrupt+0x100/0x220 | ||
[Tue Jul 21 07:02:43 2020] smp_apic_timer_interrupt+0x6a/0x140 | ||
[Tue Jul 21 07:02:43 2020] apic_timer_interrupt+0xf/0x20 | ||
[Tue Jul 21 07:02:43 2020] </IRQ> | ||
[Tue Jul 21 07:02:43 2020] RIP: 0010:cpuidle_enter_state+0xbc/0x420 | ||
[Tue Jul 21 07:02:43 2020] Code: e8 49 f0 a3 ff 80 7c 24 13 00 74 17 9c 58 0f 1f 44 00 00 f6 c4 02 0f 85 37 03 00 00 31 ff e8 db fd a9 ff fb 66 0f 1f 44 00 00 <45> 85 e4 0f 88 6c 02 00 00 49 63 cc 4c 8b 3c 24 4c 2b 7c 24 08 48 | ||
[Tue Jul 21 07:02:43 2020] RSP: 0018:ffffba3ec31dfe68 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13 | ||
[Tue Jul 21 07:02:43 2020] RAX: ffff9dffdfae9c40 RBX: ffffffffaef2a540 RCX: 00000000ffffffff | ||
[Tue Jul 21 07:02:43 2020] RDX: 00094dc87e68fb16 RSI: 00000000000043fa RDI: 0000000000000000 | ||
[Tue Jul 21 07:02:43 2020] RBP: ffff9dffdfaf3800 R08: 000ba13b3114dac0 R09: 000000000000037c | ||
[Tue Jul 21 07:02:43 2020] R10: ffff9dffdfae8be0 R11: ffff9dffdfae8bc0 R12: 0000000000000003 | ||
[Tue Jul 21 07:02:43 2020] R13: ffffffffaef2a678 R14: 0000000000000003 R15: 0000000000000000 | ||
[Tue Jul 21 07:02:43 2020] ? cpuidle_enter_state+0x97/0x420 | ||
[Tue Jul 21 07:02:43 2020] cpuidle_enter+0x2c/0x40 | ||
[Tue Jul 21 07:02:43 2020] do_idle+0x236/0x280 | ||
[Tue Jul 21 07:02:43 2020] cpu_startup_entry+0x6f/0x80 | ||
[Tue Jul 21 07:02:43 2020] start_secondary+0x1a7/0x200 | ||
[Tue Jul 21 07:02:43 2020] secondary_startup_64+0xb7/0xc0 | ||
[Tue Jul 21 07:02:43 2020] ---[ end trace 069b932bbbef0c26 ]--- | ||
``` | ||
|
||
这个报错是CFS调度器相关,可能和 [[PATCH] sched/fair: fix unthrottle_cfs_rq for leaf_cfs_rq list](https://lkml.org/lkml/2020/5/11/999) 有关,待学习分析 | ||
|
||
# 参考 | ||
|
||
* [[PATCH] sched/fair: fix unthrottle_cfs_rq for leaf_cfs_rq list](https://lkml.org/lkml/2020/5/11/999) | ||
* [Linux Kernel Scheduler Basics](https://josefbacik.github.io/kernel/scheduler/2017/07/14/scheduler-basics.html) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
|
||
|
||
# 参考 | ||
|
||
* [Linux Kernel Scheduler Basics](https://josefbacik.github.io/kernel/scheduler/2017/07/14/scheduler-basics.html) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
XFS是Red Hat主要支持的文件系统,稳定性和性能都非常出色,通常在数据库存储中广泛使用。 | ||
|
||
# 参考手册 | ||
|
||
* [xfs - layout, mount options, and supported file attributes for the XFS filesystem](https://www.linux.org/docs/man5/xfs.html) | ||
* [mkfs.xfs(8) — Linux manual page](https://man7.org/linux/man-pages/man8/mkfs.xfs.8.html) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1,7 @@ | ||
# GlusterFS | ||
在CentOS上部署GlusterFS以及Ceph等存储解决方案,当前都采用 [CentOS Storage Special Interest Group (SIG) ](https://wiki.centos.org/SpecialInterestGroup/Storage) 部署,这是一个确保CentOS完善运行不同存储解决方案的整体架构。提供了软件仓库以及文档支持。 | ||
|
||
# CentOS SIG文档 | ||
|
||
* [Documentation home for GlusterFS in Storage SIG](https://wiki.centos.org/SpecialInterestGroup/Storage/Gluster) | ||
* [GlusterFS Storage Cluster on CentOS 7](https://wiki.centos.org/HowTos/GlusterFSonCentOS) - 早期的CentOS 7部署Gluster | ||
* [SIG Gluster Quickstart](https://wiki.centos.org/SpecialInterestGroup/Storage/gluster-Quickstart) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
SR-IOV即sigle-root I/O virtualization,是虚拟化技术中将物理设备切分成多个隔离的虚拟设备提供给虚拟机或容器使用的技术。 |
Empty file.